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ABSTRACT 


This study was designed to examine the perceptions 
of teachers in an urban Saskatchewan school district 
regarding the existing and preferred use of evaluation 
personnel, and the existing and preferred importance given 
tolevabuation criteria’ 

The instrument consisted of four sections. The 
first section consisted of six personal and professional 
variables. The second section requested the scoring of 
nine listed types of personnel according to their existing 
and preferred use as evaluators. The third section 
requested theliscoring of the thirty listed criteria 
according to the importance given to them in the existing 
and preferred evaluation situation. The fourth section 
invited teachers to make comments regarding evaluation 
and/or the study. 

The statistical procedure utilized to analyze the 
data included frequency counts to determine the existing and 
preferred use of evaluators and evaluative criteria; the 
rank ordering of personnel according to their use 
"frequently" and "always" to allow comparisons to be made 
of the extent of use of these evaluators in the existing 
and preferred situation; the rank ordering of criteria 
according to the’ “great”: and: "very: gneat". importancesagiven 
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to them in the existing and preferred evaluation situation 
to allow comparisons to be made; Spearman rho calculations 
to determine whether any overall difference existed between 
the use of evaluators in the two situations and to determine 
whether any overall difference existed between the 
importance given to evaluative criteria in the two 

S2eUat TOns pec ecquare, tests to determine significant 
relationships between the six personal and professional 
teacher variables and the existing and preferred use of 
evaluation personnel, and to determine significant relation— 
ships between the six personal and professional variables 
and the existing and preferred importance given to 
evaluation criteria; and a simple categorization of 
teachers' comments on the study. 

Analysis of the data disclosed that teachers 
perceived and preferred the school board superintendent and 
the principal to be used extensively in teacher evaluation. 
Piererwas no overall difference ain uhe use of evaluators 
between the existing and preferred situation. Several 
significant relationships existed between the personal and 
professional teacher variables and the existing and preferred 
use of evaluators. Sixteen of the criteria were perceived 
to be given great importance in the existing situation, and 
twenty-eight of the criteria were preferred as important 
evaluation criteria. No overall difference between the 
existing and preferred criteria was found. The emphasis 
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Was On process criteria for the existing and preferred 
situation. Several significant relationships existed 
between the personal and professional teacher variables 


and the existing and preferred evaluation criteria. 
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Chapter 1 


STATEMENT OF THE PROBLEM AND 
ITS SIGNIFICANCE 

Rapid developments in society, industry and 
technology have placed increased demands on education. 
These new demands and the accompanying expectations have led 
to a greater awareness of the need and value of education 
and have caused a greater concern about the educational 
programs provided by educational institutions and about the 
activities which take place in the teaching-learning 
situation. This awareness and concern has necessitated a 
public policy of placing the best teachers in schools and 
has demanded an accounting of teachers' efforts in the 
teaching process and of their effects on the learner. Such 
an accounting can only be given through some sort of 
summative evaluation of teacher effectiveness which should 
separate the competent teacher from the incompetent. 
However, evaluation of teacher effectiveness is not desired 
by the public alone for evaluation can also be formative 
and is, therefore, of immediate concern to the teacher 
involved and to school administrators who desire assistance 
in their professional growth and development. 

Evaluation involves a process of assessment and a 
judgment. Whitworth (1968:124) suggested: 
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2 
Evaluation comprises two main steps, the first that 
of assessing the situation usually by measurement, 
rating, or ranking, and the second that of making a 
decision as to how acceptable the status quo is. A 
third stage, often added, consists of judging what 
should be done and planning ahead . .. . In other 
words, evaluation consists of adding value judgments to 
observations, ratings, and test results covering some 
onessituation. 
An examination of this statement indicates that 
When evaluation is applied to teacher performance, the task 
becomes very complex. This observation is supported and 
emphasized by extensive research which has attempted to 
determine the qualities and characteristics of "good" 
teachers, the "best" teaching techniques and procedures, 
the effects of various methods of teaching on students, the 
predictability of teacher success, and a variety of other 
problems related to teacher performance and effectiveness. 
Studies by Moore (1966), Thomas (1969), and Rogers 
(1970) have examined the problem of evaluating teacher 
effectiveness using Mitzel's process, product and presage 
criteria. Some articles have been written concerning the 
personnel responsible for the evaluation of teachers, but 
little agreement is evidenced in this regard. Most studies 
of this nature have ignored the views of the individuals 
who are the concern in these discussions and investigations, 
namely, the views of the teachers. This study was designed 
to examine the evaluation of teacher effectiveness from the 


point of view of teachers in an urban Saskatchewan school 


aistrictk. 
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STATEMENT OF THE PROBLEM 


The major purpose of this study was to examine the 
perceptions of teachers in an urban Saskatchewan school 
district regarding (1) the existing and preferred evaluation 
personnel and (2) the existing and preferred evaluation 
eriteria. 

Specifically, the study was concerned with the 
following questions: 

1. To what extent do certain individuals or groups fulfill 
the evaluation of teacher effectiveness function as 
perceived by teachers in an urban Saskatchewan school 
districte 

2. Which individuals or groups responsible for teacher 
evaluation do these teachers prefer? 

3. Is there a relationship between teachers' perceptions 
of existing evaluation personnel and the personal and 
professional variables of age, sex, years of teaching 
experience, years of post-secondary education, level of 
instruction, and position held? 

4. Is there a relationship between teachers' preferences 
of evaluation personnel and the selected personal and 
professional variables? 

5. What is the importance given to criteria employed in 
the evaluation of teacher effectiveness as perceived by 
these teachers? 


6. Is there a relationship between teachers' perceptions 
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4 
of existing evaluation criteria and the selected personal 
and professional variables? 

7. Do urban school teachers perceive the emphasis to be 
placed upon process, product or presage evaluation criteria? 
8. What importance given to evaluation criteria do these 

teachers prefer? 

9. Is there a relationship between urban school teachers' 
preferences of evaluation criteria and the selected personal 
and professional teacher variables? 

10. Do teachers in this school district prefer the emphasis 


to be placed upon process, product, or presage criteria? 
IMPORTANCE OF THE STUDY 


This study, believed to be the first of its kind 
conducted in an urban Saskatchewan school district has 
potential merit in that it should: 

1. Provide an analysis of the existing evaluation system 

as perceived by teachers for those responsible for 
evaluation thereby enabling them to determine if these 
perceptions coincide with their own perceptions of the 
existing evaluation system regarding evaluation personnel 
and criteria. If these perceptions do not coincide, 
corrections can be made and reorganization can be sought. 

2. Provide an analysis of evaluators and criteria preferred 
by these teachers thereby enabling those responsible for 
evaluation to accommodate these preferences. If such 


preferences are accommodated, the resulting increase in 
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5 
co-operation and understanding will lead to a more effective 
formative and summative evaluation. 

3. Indicate to the individuals or groups who are 
responsible for teacher evaluation what the role perceptions 
and role expectations of the teachers are. 

4. Provide evaluators with an analysis of the relationship 
between teachers' perceptions and preferences regarding 
evaluation and selected personal and professional variables. 
Such an analysis will provide guidelines for approaching 
evaluation with particular individuals or groups. 

5. Give teachers an opportunity to influence evaluation 
procedures by indicating their expectations and desires 
regarding evaluation. 

6. Give teachers an opportunity to discover how other 
teachers perceive evaluation and what they prefer in this 
regard. 

7. Focus attention on an area of educational concern. The 
information provided should be of interest to teachers, 
administrators, school boards, professional organizations 


and members of the community. 
BACKGROUND TO THE STUDY 


All teachers are evaluated. Regardless of the 
formality of the evaluation, the method of collecting and 
analyzing evidence, and the procedure for reporting, 
teachers are evaluated and they are evaluated rather often 


by students, parents, other teachers, administrators, 
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6 
supervisors, and the public. The pa cen lene facing teachers 
and administrators concern the extent of involvement that 
these individuals and groups should have in formal 
evaluations of teacher effectiveness, and how systematic 
the evaluation should be in order to be most effective. 
Since the emphasis on teacher evaluation has increased, and 
since teachers are the subjects of this process, the views 
of teachers concerning evaluation may provide considerable 
information concerning evaluation personnel and evaluative 


Criteria. 
DEFINITION OF TERMS 


Evaluation--assessment by measurement, rating or 
ranking of teacher effectiveness involving value judgments 
based on observations. Such evaluation may be formative or 
summative. An elaboration of this definition is given on 


pages 9 and 10. 


Product criteria--relate to measurable aspects of 
student growth, or change in attitude and behavior which 


can be attributed to the effect of the teacher. 


Process criteria--refer to those aspects of teacher 
behavior considered to indicate teacher competence. They 
involve teaching methods, techniques and strategies, 


student-teacher relationships, and classroom situations. 


Presage criteria--involve personal and professional 
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characteristics of the teacher, such as personality, 


appearance, training and intelligence. 


Teachers--those individuals who are directly in 
the teaching process. This includes the principals who 
are the principal teachers in the schools. ‘Teachers in 
this study were elementary and secondary school teachers 
with grade or grades taught ranging from kindergarten to 
grade twelve. The term instructor was used interchangeably 


with teacher. 


Separate schools--are those schools in a specific 
district in which the minority of ratepayers, whether 
Protestant or Roman Catholic, have established their own 
schools, in which they are liable only to assessments of 
such rates as they impose upon themselves, and whose legal 
base stems from the North West Territories Act of 1875, 
The Saskatchewan School Act, and The Secondary Education 
Ace Or tooe, = Une separate schools referred to in this 


study were Roman Catholic schools. 
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Chapter 2 


REVIEW OF RELATED LITERATURE AND RESEARCH 


Much has been written on the subject of evaluating 
teacher effectiveness. The views and evidence provided by 
research in this area are often contradictory. Forbes 
(1965) reported that the views held in this regard range 
from those which suggest that teacher quality is impossible 
to measure because of the complexity of the teaching-learning 
situation, to those which suggest that teacher effectiveness 
can be determined on the basis of a fifteen minute 
observation. This difference of opinion was further 
emphasized by Medley and Mitzel (1963:257) who suggested: 

No fallacy is more widely believed than the one 

which says it is possible to judge a teacher's skill 
byeWwatchinguhim~eteach. Slt as difficult to find anyone, 
professional educator or layman, who does not think he 
himself, at least, can recognize good teaching when 
he sees it. 
These views indicate some of the problems associated with 
this area of concern. 

Numerous studies by individuals, school systems, 
and by teams of researchers have investigated separate 
facets of the teacher evaluation problem. Biddle and 
Ellena (1964:v) indicated some of the areas of concern and 
proposed that: 


Probably no aspect of education has been discussed 
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2) 
with greater frequency, with as much deep concern, or 
by more educators and citizens than has that of 
teacher effectiveness-—-how to define it, how to 


identify it, how to measure it, how to evaluate it, and 
how to detect and remove obstacles to its achievement. 


WHAT IS EVALUATION? 


Evaluation in education is a broad term covering 
all forms of judgments, including ratings or rankings, in 
Which the degree of suitability or acceptability is 
measured and described. Evaluation of teacher effectiveness 
may be formative (for the purpose of promoting the 
professional growth and development of the teacher) or 
summative (for the purpose of official reporting of the. 
effectiveness of the teacher which may lead to a decision 
regarding the acceptability of teacher performance). Ryans 
(1963:292) has taken the position that teacher evaluation 
is partly dependent on the attributes of the teacher and 
partly dependent on the teaching situation. He suggested 
that: 

Teacher description is concerned with the 
identification, inventorying, and determination of 
interrelationships of teacher characteristics and 
behaviors. Teacher evaluation, on the other hand, 
involves judgments of the quality of teacher 
behaviors--—judgments made in light of agreed-upon 
educational objectives, expectancies of individuals 
or groups, and other evaluative criteria approved by 
the schools and the community. 

In evaluating teachers, the emphasis is on making judgments 
in relation to objectives, not on judging the personal 


worth of people. Vander Werf (1958:55) pointed out that 


teacher evaluation: 
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- « must always place its emphasis one-the 
emerging, qualitative, and aesthetic aspects of 
professional performance, whether it be in the 


classroom, in the community, or in the profession 
itsebtx 


THE PURPOSE OF EVALUATION 


The reasons presented for evaluating teachers are 
numerous. These reasons can be generally categorized as 
(1) the public reason; (2) the professional reason; and 


(3) the administrative reason. 


The public reason. Teachers are responsible to 
parents and the general public for providing their chistaren 
with the best possible learning experiences and to ensure 
each child a quality education. In order to ensure that 
this is being accomplished evidence must be provided in 
terms of prespecified goals and objectives. Such an 
accounting cannot be given without evaluating teachers and 
the effects of their teaching upon the students in their 


Charge. 


The professional reason. Teachers are evaluated 
so that their teaching can improve and reach its potential. 
In this regard Vittetoe (1971:7) stated: 


The old assumption that teachers are qualified to 
teach if they have a college degree is rejected now 
by those who see that we must find a way to evaluate 
teachers, eliminating the ones that are poor, eventually 
rewarding those that are good, and above all improving 
the product--that is, the kind of individual that our 
colleges and universities are developing for the 
profession. 
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The administrative reason. The administrative 
reason is primarily concerned with administrative decisions 
about the effectiveness of teachers. As Rogers (1970:16) 
stated: "Teacher evaluation leads to the determining of 
the salary, tenure, dismissal, and promotion of the teacher." 
Although this reason is similar to the public reason noted 
above, it differs in that it involves a decision about 
change of the teacher's status. 

A study of teacher evaluation procedures conducted 
by the Educational Research Service (1969:71) in 211 local 
school systems in the United States identified ten ways in 
which teacher evaluation might be used. These are (in rank 
order of importance as identified by the teachers surveyed) : 
1. To assist in improving teaching competence. 

2. To keep the administration aware of what is going 
on in the classroom. 

3. To make teachers more responsive to needs of 
their pupils. 

4. To make it possible to dismiss poor teachers. 

5. To assist in the selection of teachers for 
promotion to other positions. 

6. To have a statement in the teacher's permanent 
record for future reference. 

7. To see if the curriculum is being followed. 

8. For advancement on the salary schedule. 

9. For the awarding of merit pay. 

Owg ther. 

The major emphasis and reason for evaluating 
teachers is to bring about improvement in teaching and 
learning. McNally (1972) indicated that there are four 
views of how evaluation of teachers can do this: (1) when 


teachers are evaluated they are motivated to do better; 


(2) during the evaluation process the supervisor teaches 
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the teacher how to teach; (3) ave lation stimulates the 
teacher to evaluate himself; and (4) evaluation is a 
co-operative study not only of the teacher but also of the 
entire learning situation which leads inevitably to 


improvement of children's learning experiences. 
PROBLEMS OF EVALUATION 


The difficulty of evaluating teachers arises from 
problems associated with (1) defining what is to be 
evaluated, (2) evaluating a complex phenomenon, (3) the 
failure of research to produce substantial and significant 
results, (4) subjective evaluation, and (5) the inadequacy 
of programs for the measurement and prediction of teacher 
effectiveness. These problems have led many researchers 
and practitioners, as well as teachers, to become 
suspicious of evaluation practices and to question the 
entire procedure. Byrne (1962:19) pointed out that in spite 
of the problem associated with teacher evaluation, laymen 
do not shrink from the task: 

Most people believe that the identification of 

good teaching is a simple matter. What community is 

not prepared to judge the quality of its teaching staff? 
What student does not have convictions regarding the 
competence of his teachers? And what school board 
hesitates, at the slightest provocation, to pontificate 
the nature of effective instruction? . . . For those 
charged with the responsibility of evaluating teaching, 
however, the task is not quite so simple. School 
administrators are keenly aware of the complexity of 


teaching. They are not always positive what teacher 
is a 7good jteacher. 
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Problems of Definition 

The problem of definition is basic to the problem 
of teacher evaluation. Definitions of good teaching, 
teacher effectiveness, and teacher competence are often 
unsupported by research evidence and are as numerous as 
the number of evaluators. Mueller (1971:229) in reviewing 
numerous research studies, concluded that: 

Although research has identified teacher 
characteristics and behavior and developed instruments 
to record objectively what goes on in the classrooms, 
no overall definition of what constitutes good teaching 
has yet evolved from the research. 

A similar problem exists in attempts to define 
teacher competence and teacher effectiveness. Getzels and 
Jackson (1963:575) pointed out that there is evidence 
showing a lack of agreement about a definition of teacher 
effectiveness in that "teachers, students, and supervisors 
differ on what constitutes teacher effectiveness." 

Most researchers indicated that teacher competence 
and teacher effectiveness have the same meaning. Biddle 
(1964), Byrne (1965), and Medley and Mitzel (1962) defined 
teacher competence in the same manner. Medley and Mitzel 
(1962:317) stated: 

The competence of a teacher is defined as the 
average success of all his behaviors in achieving their 
intended effects. Strictly speaking, we cannot assess 
the competence of a particular teacher unless we know 
what effects he is seeking to achieve ... . The 
competent teacher is one who is able to produce those 
effects he intends to produce. 


A similar definition is given for teacher effectiveness. 


Flanders (1969:1423) proposed: 
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14 
Teacher effectiveness is an area of research which 
is concerned with relationships between characteristics 


of teachers, teaching acts, and their effects on the 
educational outcomes of classroom teaching. 


Medley and Mitzel (1962), Biddle (1964) and Byrne (1965) 
elaborated on this definition and suggested that teacher 
effectiveness also includes the effects of a given situation 
orpxcontexte 

Barr (1961), Ellena (1961), and Turner and Fattu 

(1961:10) summarized the problem as follows: 

One of the most difficult problems in the study of 
teacher effectiveness has been whether to assume that 
"effectiveness" is a statement about an attribute of 
the teacher, whether it is a statement about an 
attribute of a teacher in a particular teaching 


Situation, or whether it is a statement about the 
results which come out of the teaching situation. 


Complexity and 
Variability 


Researchers engaged in the study of teacher 
effectiveness agreed that it is a difficult area of study 
because it involves a wide range of human phenomena, 
qualities and skills and because the results of teaching 
must be observed in delayed and inferential fashion. 
Anderson and Hunka (1963:75) asserted: 

Teaching is a complex business and any psychometric 
approach to the measurement of teaching success which 
assumes that there are common and stable factors in the 
teacher and his environment must meet with indifferent 
success. Teaching proficiency is multidimensional and 
there are many kinds of effectiveness for different 
kinds of teachers, programs and situations. 


Many practitioners and researchers (Bolton, 1971; 


Ratsoy, 1971; Flanders, 1969; Smith, 1967; Lawler, 1964; 
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Ryans, 1963) agreed that a teacher functions in a highly 
complicated setting, in which his performance is influenced 
by the interaction of his personal characteristics and 
various situational variables. Flanders (1969) suggested 
that teacher behavior varies from one time period to the 
next according to the nature and purpose of the learning 
activities. Lawler (1964) emphasized that teachers' 
classes vary and concluded that a fair evaluation of a 
teacher's performance can only be made on the basis of 
several years experience. Gallagher (1968) agreed with 
this view and added that a teacher's style can only be 
ascertained if numerous evaluations are made. Ratsoy 
(1971) cautioned that situational variables such as 
characteristics of the physical setting, the instructional 
objectives, the materials being used, and the goals of 
the institution must also be recognized and considered 
when evaluating teachers. In this regard, Turner (1970:158) 
concluded from his review of several research studies: 
Considered in its entirety, the empirical evidence 
contained in the studies noted above seems to the 
writer to support the contention that good teaching is 
a contextual phenomenon. Moreover, the effects of 
contextual variables are not limited to a single 
criterion outcome such as student reports and 
evaluations, but also appear when student achievement 
is considered critical. 


The interaction of these variables further emphasizes the 


difficulty of teacher evaluation. 
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Failure of Research 
Researchers who have reviewed the extensive studies 
of teacher effectiveness and teacher evaluation concluded 
that these studies have been inconclusive and have added 
little to our knowledge. Soar (1964:287) concluded: 


Despite an extensive literature accumulated over 
the years, one of the central points on which reviewers 
agree is that very limited progress has been made 
toward prediction and assessment. The number of 
studies in which objective procedures for evaluation 
have been used represent only a small fraction of the 
total, and of these, the variables measured have often 
been limited in breadth and peripheral in importance. 


This conclusion was in agreement with the 
conclusions of the authors of the chapters on teaching 
methods; teacher personality,; and socialstinteraction in 
the classroom in the well-known Handbook of Research on 
Teaching (N. L. Gage, ed., 1963) who also stated that the 
research evidence was inconclusive. 

Although these conclusions may lead to a pessimistic 
attitude, Gage (1967:15), having examined more recent 
research, sounded a note of optimism for the future: 


More complex research designs capable of taking 
more categories of significant variables into account 
are now being propounded. The psychological, 
educational, and methodological sophistication of 
research workers is being greatly raised by greatly 
improved predoctoral and post doctoral training programs. 
And more adequate financial support is providing 
better organizations and facilities for educational 
research and development. The faith persists that 
educationally significant differences can be 
consistently produced in the future as new intellectual 
and material resources are brought to bear on 
educational problems. 
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17 
Subjectivity 

The problem of evaluation of teacher effectiveness 
is compounded by the lack of objectivity in evaluation. 
Researchers pointed out that subjectivity in evaluating 
teachers continues to frustrate evaluators, teachers, and 
those who depend upon evaluation for teacher selection, 
promotion, and development. In this regard, Hawkins and 
Stoops (1966:344) concluded that: 

Training and experience .. . are about the only 
objective evaluation measures of teacher differences 
we have found; yet they have generally been omitted 
from the evaluation process. 

Evaluation of teachers involves value concepts and 
value judgments. Ryans (1963:292) suggested that value 
systems on which judgments are based "grow out of one's 
personal biases, preferences, beliefs, opinions, and 
attitudes; all of which vary substantially from one 
individual to the next." This comment was in agreement 
with that of Barr (1961:5) who stated that in 

. . . uncontrolled situations the judgments of a 
group of supervisors and administrators, all observing 
the same teacher teach at the same time, under 
1dentical conditions, may vary so much that some 
observers may rate a particular teacher as among the 
very best they have observed. 

This lack of agreement among evaluators was demonstrated 
by Worth's (1961) experiment involving Canadian school 
administrators. 

Worth's (1961) study of 128 Canadian administrators 


observing and evaluating the same lesson demonstrated that 


the range of evaluative comments was from exceptional to 
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18 
weak. In each of the twelve areas of instructional 
awareness-—-classified from the free responses of the 
administrators--the teacher was both highly praised and 
severely criticized. From this evidence, Worth concluded 
that the raters were not guided by any common definition 
of good teaching and theory of learning. 

Worth's (1961) study was supported by Flanagan 

(1961:329) who concluded from his own research: 

Regardless of the meaning of supervisory ratings, 
teachers are usually judged by their superiors and 
administrators. In general, these evaluations are 
made upon the basis of general impressions made of the 
teacher in many personal contacts, in observing 
classroom performance, and upon reports from others, 
rather than a single objective measure of teaching 
efficiency .. . Regardless of what else the teacher 
may have done, right or wrong, if he pleases the 
administration he is rated highly and consequently is 
considered to be a good teacher. 

Criteria and Measurement 

In addition to the problems associated with 
evaluating teacher effectiveness indicated above, problems 
also exist in relation to evaluation criteria and measure- 


ment techniques. These problems are discussed later in 


this chapter under separate headings. 


Teacher Anxiety 
Klahn (1965) suggested that because of unpleasant 


past experiences, evaluation poses a threat to many people. 
Changes in the teacher may be precipitated as a result of 
the process and when changes are possible, teachers feel 


vulnerable. Brown (1962), while investigating the effects 
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19 
of stress-inducing supervisory behavior on the performance 
of teachers, found that stress or threat induced into the 
teaching situation generally caused a deterioration in 
teaching performance, particularly in those aspects 
involving pupil rapport, interaction, warmth and personal 
understanding. The performance exhibited by the teacher 
would not, therefore, be representative of his best efforts. 
Can Teachers be 

Evaluated? 

In view of the many problems associated with teacher 
evaluation, the question of the ability to evaluate teachers 
remains to be answered. There appears to be no general. 
agreement on this matter for there are as many people who 
say that it can be done as there are who say that it can 
not be done. 

Beery (1962) asserted that the elusiveness of human 
traits, the complexity of teaching and learning, and the 
variety of desired teaching outcomes have prevented the 
discovery of any simple and objective measure of teaching, 
and he doubted that such a measure could ever be devised. 
Ellena (1961) reported the views of Rabinowitz and Travers 
(1953) who proposed that the distinction between effective 
and ineffective teachers cannot be made without value 
judgments which makes the effective teacher a fiction in 
the mind of man. Laurits (1967:35) defined teaching as a 
process by which changes in behavior are effected in an 


individual and concluded: 
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20 
Our definition of teaching supports the view that 
the evaluation of individual teachers leads nowhere, 
for the definition asks us to examine life through the 
eyes of the student himself, to evaluate the larger 
experiences that the student is having in the school. 
Among those who proposed that teachers can be 
evaluated were Heil and Washburn (1962), Bargen (1965), and 
Ey aem BOGu eRe ndingeror uchentie, | «ana Washburn (1962) 
study of teacher effectiveness involving fifty-five 
teachers and their students provided evidence that there 
are identifiable types of teachers and that different 
types have different effects on the children whom they 
teach; certain ones seemingly are more effective than 
others. Bargen (1965:15) contended that teaching is not 
too complex to be evaluated objectively for "teaching is 
a specific form, or set of forms, of habitual human behavior; 
it is observable, measurable, analyzable, differentiable, 
and modifiable." Ryans (1967) supported this view but only 
conditionally. He held that either unidimensional or 
multidimensional evaluation can be accomplished objectively 
if agreement can be reached on evaluation criteria and on 
weights given to different aspects of teacher behavior. 
Dissatisfaction with 
Evaluation 
Teachers, like many administrators and supervisors, 
are frequently dissatisfied with evaluation. Freehill 
(1963) asserted that this is often due to unclear standards, 
brief observations, overemphasis on personal teacher 


characteristics, and evaluation of teachers in positions 
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unlike those for which they are recommended. Bolton 
(1971:4) suggested that teacher dissatisfaction is created 
where there is 

-+»-- emphasis on fault—finding rather than helping 
teachers; when prejudice, bias, and poor judgments 
are used in collecting and analyzing information, and 
when communication is not open and honest. 
These traditional aversions to evaluation have created an 


environment of ambiguity and frustration in terms of 


educational improvement. 
WHO SHOULD EVALUATE? 


In spite of the many problems associated with 
teacher evaluation, and regardless of the debate about 
whether teachers can or cannot be evaluated, the fact 
remains that teachers are evaluated by a variety of people. 
In most school systems, the responsibility for evaluating 
teachers is not the domain of any one individual, but 
rather it lies in the hands of a cadre of administrators 
who perform this function and in relation to the time 
allotted them for this task. The question of "who should 
formally evaluate teachers?" is often answered in numerous 
ways with a range from the students to external 


administrators; from individuals to teams of experts. 


External Evaluation 
In most Canadian provinces, evaluation of teaching 
is sometimes conducted by individuals or groups who are 


external to the actual school setting. These personnel 
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are often engaged in evaluating the school, and evaluate 
specific members of the school staff only in as much as 
they affect the operation of the school as a whole. On 
Occasion they are engaged in evaluating individual 
teachers, but these evaluations only take place when 
specific, extraordinary and crucial problems concerning a 
teacher arise. Of such evaluations, Byrne (1965:306) 
stated: 

External evaluation is commonly observed to be the 
least significant of all steps in the entire process. 
Its importance resides in its being the climax 
following a long period of self-appraisal. It provides 
intrinsic motivation for completing this extended 
period of critical self-examination. 


From this observation, it would appear that the most 


Significant evaluations are those internal to the school. 


Supervisors 


Worth's (1961) study concerning evaluations by 
school administrators reported above has indicated some of 
the problems associated with supervisory evaluations. The 
lack of agreement of such evaluations was further supported 
by Barr (1958) who cited a research report by Webb and 
Nolan who found that when instructors were rated by their 
students and supervisors and by themselves, student ratings 
and self-ratings were highly correlated, and supervisors' 
ratings were correlated with self-ratings and additional 
measures Of instructors' characteristics. 

Some researchers, however, see supervisors' 


evaluations as having distinct advantages over other 
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22 
evaluations for the psychological distance from the 
Situation can enable them to view the situation objectively. 
This view was held by Moore (1966:19) who further suggested 
that it is "this psychological distance which enables him 
to make comparisons and to set standards of performance 
and which places him in the best strategic position to carry 


out evaluation." 


Principam 

There is some argument regarding the principal's 
role in the formal evaluation of teachers' effectiveness. 
Enns (1965) and Andrews (1959) suggested that it is 
difficult for a principal to play the dual role of motivator 
and evaluator. They suggested that the principal's role 
involved provision of leadership, establishment of 
organizational climate, and a myriad of other tasks which 
involve supervisory contact with staff. They contended that 
evaluation which involves inspection and assessment would 
interfere with this role and that the two roles cannot be 
performed simultaneously. 

Bargen (1965), McNally (1972) and McNeil (1971) did 
not agree with the foregoing premise. Bargen asserted that 
because of his role as educational leader and because of 
his proximity to the teaching situation, the principal is 
the most suited person to evaluate teachers. McNeil 
(1971:133) supported this view and stated that a "principal 


is remiss if he has not established and carried out a plan 
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for monitoring the effectiveness of teachers." McNally 


(1972:357) reviewed studies regarding this matter and 


concluded: 


The multitude of studies that have been made on 
teacher evaluation leave no question that the principal 
is the key person in the program. It is the rare 
school system where the principal is not the person 
most responsible for teacher evaluation. It follows, 
then, that principals are the people on whom the 


quality, 


the nature, and the effectiveness of the 


evaluation program depend most. 


Metzner (1970) cited research to show that teachers 


received a high rating from their principal if they shared 


ENnCa Donic. oa |. 


relationships 
teachers, and 
students. In 


evaluation by 


Ss educational beliefs, if they had harmonious 
with colleagues, if they were good classroom 
if they were sensitive to the needs of their 
the face of this evidence he warned that 


the principal may induce teacher conformity 


and create a tendency to rate teachers without reference 


to changes in 


their students. 


Department Head 


There 
be evaluated, 


the teacher's 


are those who suggest that if teachers are to 
the evaluator should have some expertise in 


subject area. Squire and Applebee (1964:9) 


agreed with this view and proposed: 


Whether such evaluation means dismissal, tenure, 
or an additional salary increment, the teacher has a 
right to expect that the person who is most knowlede- 
able about him, his subject, and the varieties of 
teaching methods open to him should judge his 
competence. Although the school principal can judge 
in part and, in larger districts, the subject matter 
specialist can judge in part, the department chairman 
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is probably most highly qualified to weigh all parts. 


Peer Evaluation 

The evaluation of teachers by their colleagues has 
received little attention from researchers. Although there 
has been some evidence provided by the research studies 
reported by Ellena (1961) that there is substantial 
agreement between peer and supervisor ratings, this area of 
investigation has been largely neglected. Moss (1971:16) 
Submutced «that: 

Estimates of teacher effectiveness by colleagues 
visiting the classroom have been labeled ineffective 
since the colleagues are usually good friends and a few 
visits can not give the whole picture of a semester's 
teaching. 

Brain (1965:35) pointed out that "how a teacher is viewed 


by his peers . . . appears to be more of a function of 


personality than of his teaching effectiveness." 


Self-evaluation 

Recent studies in the area of teacher effectiveness 
have focused on the topic of teacher self-evaluation. Many 
researchers (Rose, 1958; Vander Werf, 1958; Flanders, 1964; 
Klahn, 1965; Joyce and Hodges, 1966; Laurits, 1967; Dial, 
1970; Roberson, 1971; and Rasmussen and Holobinko, 1971) 
stated that this type of evaluation is most valuable for 
educational improvement. The reasons for supporting 
self-evaluations expressed by these researchers ranged from 


teachers being more aware of their own weaknesses than are 
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26 
recognized by other members of the staff, to the belief 
that it is only through professional, dispassionate and 
scientific self-evaluation that improvement of instruction 
can be realized with long range effects. Roberson (1971: 
469) indicated: 

The results of intensive research and observation 
of the teaching-learning process in the classroom 
indicate that no one particular style of teaching can 
be declared the model for everyone; rather, the need 
appears to be for self-appraisal, the opportunity for 
each teacher to find and develop his own effective 
style. 

Moss (1971:16), however, cautioned against this evaluation 
scheme because "the teacher is too close to the situation 
to make accurate or fair judgments about his own 
effectiveness." 

A recent study of Alberta teachers conducted by 

Green (1971) which pertained to teacher attitudes and 
self-ratings of success in teaching also indicated caution 
in this regard. Green (1971:85) found that in self-ratings 
of teaching success (1) process criteria were most 
frequently chosen, (2) presage criteria were rated higher 
than process and product criteria, and (3) the self-rating 


was influenced by prior held attitudes, university training, 


sex, and age. 


Student Evaluation 
Despite the fact that some teachers question the 
value and reliability of student evaluation of teacher 


competence, this procedure has received increased attention 
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27 
in recent» years:) «This is primarily due to the positive 
evidence provided by various research studies that student 
evaluations are accurate and reliable, and the belief that 
because students see teachers in day-to-day teaching 
Situations, they cannot be ignored as evaluators. 

Research conducted by Rayder (1968) demonstrated 
that there is no substantial relationship between student 
ratings of instructors and students' sex, age, grade point 
average, or grade(s) previously received from the 
instructor being rated. Moss (1971) and Bledsoe (1971) 
pointed out that research indicates Die cesuldent sears 
competent evaluators, that teachers' sex does not bias the 
evaluation, that students'ratings relate positively to a 
teacher's teaching and communicating ability, and that the 
results of student ratings are as reliable (self-consistent) 
as our better educational and mental tests. 

The research conducted by Ely (1959) supported the 
proponents of student evaluations who believe that in spite 
of the possible shortcomings of such ratings, students do 
provide valuable information concerning the behavior of 
teachers. This aspect of student evaluation was supported 
by McBeath. McBeath's (1959) study related teacher behavior, 
as described on the ateacnen Leader Behavior Description 
Questionnaire, to teacher effectiveness. McBeath (1959: 
110) concluded: 


Students appeared to relate teaching effectiveness 
to the teacher's leader behavior and there was some 
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28 
indication that they believed human relations behavior 
(Consideration) was more closely related to effective- 
ness than was goal accomplishment behavior (Initiating 
Structure). 

Although the evidence supporting student evaluation 
of teachers is substantial, there is also some evidence 
which warrants caution when considering students as 
evaluators. Caution is warranted by personal character- 
istics of students which have been shown to influence 
ratings given to instructors. This was demonstrated by 
Anderson (1960) whose research study, cited by Flanders 
(1961), showed that dependent-prone students see teacher 
behavior differently than do the less dependent prone and 
that their expectations of the teacher's role is different. 
A similar study by Bledsoe (1971) revealed a stable, 
consistent, and positive relationship between pupil grade 
and teacher performance. This study showed that students 
who received high grades rated their teachers highly, and 
students who had received low grades gave teachers low 
ratings. No inconsistencies were found as one moved from 
"A" to "F" on the rating scale. Mueller (1971:230) 
cautioned that "too little research has been done on student 
rating to rely too heavily on this method of assessing the 


effectiveness of teachers." 


Team Evaluation 
Some teachers are reluctant to be evaluated because 


of unpleasant evaluation experiences. Their fears and 
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29 
anxieties are often produced when one evaluator rates 
their effectiveness on the basis of a brief observation 
and on limited information. One method of reconciling 
these fears and anxieties is by team evaluation. Klahn 
(1965:16) suggested: 
A part of the total responsibility for evaluation 

of teaching rests with each professional person as he 

functions in his role as teacher, supervisor, and 

administrator. Evaluation will lack effectiveness if 

a composite picture does not evolve from the 

contributions of many evaluators. 
This view was supported by Ryans (1967:56) who proposed that 
"the pooling of independent ratings of judges constitutes 
a reliable assessment of a teacher's performance, © ang by. 
Vander Werf (1958) who submitted that teacher evaluation is 
a process involving the teacher, the immediately responsible 
administrator and another person. He further suggested 
that three conditions must be kept in mind for best possible 
results: evaluators (1) must have adequate training and 
preparation for this responsibility; (2) must be carefully 


selected for these positions; and (3) must be given enough 


time to make adequate appraisal. 
METHODS OF EVALUATION 


The two most common methods used in appraising 
teachers are rating scales and systematic observation. In 
these evaluation methods, four types of measures are used: 
(1) rank ordering--individuals are grouped according to 


some item; (2) forced distribution--each item is given a 
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percentage; (3) absolute category--behaviors are described 
by placing incidents into frequency or descriptive 
categories; and (4) verbal descriptors--perceptions are 
expressed. Simon and Boyer (1970) described seventy-nine 
observation schedules available for use, some of which 
focus on narrow aspects of classroom behavior while others 
are broader in scope. However, researchers point out that 
no approved methods of measuring teacher competence have 
been accepted: 

Observations are usually poor measures of teacher 
effectiveness since results are ungeneralizable beyond the 
Situation under observation and subject to observer bias. 
Medley and Mitzel (1963) pointed out that research workers 
indicated the inadequacy of this method because it is 
expensive in time and money, atypical behavior of the 
teacher is demonstrated when the observer is present, and 
previous studies which have employed this technique have 
had Littles suceessr 

Rose (1958), Turner and Fattu (1960), Ellena (1961), 
and Soar (1964) indicated that the problems of ratings 
have been among the more frequent contributors to the 
difficulty of measurement. As in observations, ratings are 
also subject to bias, set, and irrelevant factors that 
intrude in rating. Ellena (1961:11) stressed this problem: 

A rating scale constructed by those whose view 

centers on transmission of subject matter is likely to 


focus almost exclusively on how the teacher organizes 
and presents subject matter. A scale constructed by 
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31 
one who conceives teaching as guiding learning 
activities is more likely to stress the skill of the 
teacher in manipulating the learning environment. 

Despite the problems associated with measuring 
teacher performance, some positive indications are evident. 
Ornstein (1970) believed that some of the problems inherent 
in observation can be alleviated through rigorous observer 
training and the use of videotape recordings. Musella 
(1970) agreed with this latter technique and suggested that 
this would not only eliminate problems associated with 
measuring teacher competence but also would lead to teacher 


self-improvement. 
EVALUATION CRITERIA 


A key problem in evaluating teacher effectiveness 
is that of determining the basis for such evaluation. The 
evaluation picture remains obscure. Soar (1964:1) pointed 
out that the 

- - - number of studies in which objective 

procedures for evaluation have been used represents 
only a small fraction of the total, and of these, the 
variables measured have often been limited in breath 
and peripheral in importance. 
Various problems have already been examined in this review. 
Even if these difficulties are resolved, the complexity of 
determining the criteria on which teachers are to be 
evaluated still remains a difficulty. The question of what 


criteria will be used in evaluating teacher effectiveness 


remains unanswered since no common definition of "good" 
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teaching has been accepted. 

Researchers have attempted to provide evidence of 
the criteria which best determine the effectiveness of 
teachers. Owens (1971:77) asserted: 

Traditionally, researchers have addressed themselves 

to the study of the following criteria: 
1. The results produced, or pupil gain as a measure 

of teacher competence. 

2. The process employed in teaching, or actual 
classroom behavior. 
3. Teacher characteristics, or the equipment the 
teacher possessed for teaching. 
Many of these studies led to, or were related to, the 
general classification of criteria adopted by Mitzel (1960). 

Mitzel (1960) reviewed research studies on teacher 
evaluation and analyzed the criteria problem. The analysis 
led him to propose a three-category framework of teacher 
efrectivenesss, The first category, product criteria, 
consists of changes in the student as a result of teaching. 

These effects are variously called student gains, 

student growth or student changes, but they all involve 

measurement of change in student behavior, a portion 

of which logically can be attributed to the influence 

of the individual teachers. (Mitzel, 1960:1483) 
The second category, process criteria, consists of those 
aspects of teacher and student behavior which are believed 
to be worthwhile in their own right. Mitzel (1960:1483) 
suggested that "they are often described and measured in 
the classroom in terms of conditions, climates, or typical 
situations involving the social interaction of student and 


teacher."' The third category suggested by Mitzel is called 


presage criteria because it assumes predictive power on the 



















aovisansit besasibbs saved eee tl 
:siustiis paiwolfo 
stunsem 5 es nisp Liquq\ 10 \pesiboxt 


Sarid 
fsujos 10 ,pnidesed at boyal ; ¢ 
siz snamqiups sit 20 epider ¢- fe fs 


sit .od Bbessl[a1 sisw 10 od ra “aokbude saen3 to yaem 
. c Su ‘of = c > ‘a 4 pa 
(Q6C1) LestiM yd bodgobs siistias Yo) AoE sottiassls isiensp 
tetiosss ao esibute doisesesiz bewsivea (0882) feesiM 
elayisns sal .meidoig Sixustiias sit besylsos bas noLjsulisve 
19foss3 to x10wems1i Yicpadso-semde 6 Beogomq of mia Bel 
.Stistiio touboug .yiopest6s saxka sar -eeonsuttostie 
-pnidoses to tiues1 5 es tnabuse ond at sepaeds Fe ateaiscoo 
2nisp tasbuta holiss ylevotisy: S15 atssitio . 
eviovar ifs ysods sud. .eepnsdo, Fasbosta x0 dj 
Holstiog & \loivsrisd ansbuye af Spae 


soneuliat eft of bedydiagts sd) ape | Leokpel « 
(€BbL2:0801 , fos iM) Retiicrias iv: 


gz0nt to ptefacos sitettao sesong eens — 
bevetiad sexs io.tiw 1o0iveaded jnebite B 
(€88120001) Losdtm cae as 


a aera Hee 
festa? 0.x - BREE a 
et is 
‘ me } cow bse 

c 


33 
part of the criteria. These criteria assume a relationship 
to other criteria, either process or product. Mitzel 
(1960:1484) suggested: 

There are at least four types of presage variables 
in common use as criteria in teacher effectiveness 
research: (a) teacher personality attributes, (b) 
characteristics of teachers in training, (c) teacher 
knowledge and achievement, and (d) in-service teacher 
status characteristics. 

Product Criteria 

A great many pages have been written to demonstrate 
that the best measures of teachers' classroom performance 
are pupils' learnings. In their attempt to establish 
evaluation criteria, Morsh and Wilder (1954) summarized and 
synthesized 360 selected studies on teacher evaluation 
Gdaeinigmeconn 00mLOmlo> 2 eandeconcluded thats the most direct 
and reliable criterion seems to be evidence of student 
change. Laurits (1967) supported this premise and proposed 
that the criterion is the degree to which desired change 
is attained. Mueller (1971) reviewed more recent studies 
and concluded that researchers still feel that student 
achievement is, on the whole, still the most reliable 
measure available. 

Other researchers pointed out that there are many 

difficulties which intrude upon this prospect. Although 
Medley and Mitzel (1963) contended that the effects of 


teaching on pupils cannot be observed in normal classroom 


behavior but can be theoretically assessed without seeing 
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34 
teachers teach, Biddle (1964) questioned if an individual 
teacher's contributions can be isolated and distinquished 
from those of others. Flanagan (1961) indicated that 
teacher ratings based on pupil gains and supervisory ratings 
of teachers did not correlate hightly. Smith (1967:66) 
statedathat “there is:veryolittle,; if any,» positive 
relation between ratings of teachers and achievement of 
their pupils." Ellena (1961:19) concluded that: 

Though elaborate statistical and experimental 
methods have been developed, there is no one who can 
demonstrate a scientific way of making effective use 
of pupil gain criteria in measuring teacher 
effectiveness. 

Bnocesse€rtteria 

Process criteria pertain to teacher and student 
classroom behavior which are considered worthwhile in their 
own right. Biddle (1964) believed that such behaviors can 
be observed directly and studied objectively. Kleinman 
(1966:237) concluded from his historical review of related 
research that "measurement of behavior by observation 
appears to be the most promising technique to date for 
assessing teacher effectiveness." 

Medley and Mitzel (1962) conducted research to 
discover patterns of classroom behavior characterized by 
errective teachers. They studied effectiveness through the 
study of emotional climate, subject matter or verbal 
emphasis of the teacher, social organization and classroom 


control. Medley and Mitzel (1962:320) concluded by saying: 
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33 
Some behavior patterns effective in securing high 
ratings from supervisors, high pupil-teacher rapport, 
and a wholesome classroom atmosphere have been 
identified, but no progress has yet been made in 


finding behaviors effective in stimulating pupil 
growth. 


In another article, Medley and Mitzel (1963:258) asserted: 

Since it may be assumed that whatever effects a 
teacher has on pupils must result from his behaviors, 
it is only necessary to identify the crucial behaviors, 
record them, and score them properly to measure 
effectiveness in process. 

Ryans (1960) conducted extensive research to 
determine what characteristics and behaviors identify 
effective teaching. His study focused on three dimensions 
of teacher behavior--warmth, organization and stimulation, 
and seven teacher characteristics--favorable opinion of 
students, favorable opinion of classroom procedures, 
favorable opinion of personnel, traditional versus child 
centered approach, verbal understanding, emotional 
stability, and validity of response. Turner and Fattu 
(1960b:19) outlines his strategy as consisting of: 

(1) searching for relationships between classroom 
behaviors of the teacher and the concurrent and 
subsequent behaviors of pupils, (2) identifying the 
specific conditions under which a specific relationship 
between a pattern of teacher behavior and a pattern of 
pupil behavior occurs, and (3) demonstrating that a 
teacher with known characteristics will, in fact, engage 
in a particular set of classroom conditions. 

Ryans concluded that knowledge of these characteristics 
and behaviors of teachers provides a basis for evaluating 


teachers. 


As a result of their extensive research on teacher 
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36 
evaluation, Turner and Fattu (1960) proposed that the best 
way to examine teacher behavior is by studying the teacher's 
ability to define and to resolve teaching problems and his 
ability to improve his problem-solving skills. They 
suggested that the establishing of teaching goals might be 
identified as problem-creating activity, and that a 
teacher's responses to actualize these goals might be 
identified as problem-solving activity. They also proposed 
that problem-solving skill, acquired through training and 
experience, can be measured by teacher performance in 
Simulated teaching tasks. 

Anderson and Hunka (1963) criticized the 
problem-solving theory because it is concerned with 
constructs rather than predictability, it is too strongly 
oriented towards teaching process, and it is applicable 
only in a covert rather than overt classroom situation. 

Flanders (1961;1962) developed an interaction 
analysis system which gave some insights into sequential 
and predictable character of teacher-learner interaction. 
This system focused attention on the verbal participation 
of teachers and students in the classroom thereby providing 
the teacher with systematic information about his 
spontaneous behavior. Patterns of teacher verbal behavior 
were compared with pupil gain in achievement. 

It was found that the attitudes of students toward 

the teacher and class were significantly more con- 


structive in classrooms in which achievement was higher. 
The verbal patterns of teachers in the superior 
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classrooms were significantly different from those in 
below average classrooms. (Flanders, 1961:175) 


He suggested that this approach has many implications for 
teachers and evaluators. However, Flanders (1969:1434), 
in his review of teacher effectiveness research, cautioned 
thats cool liet le ws known about classroom interaction. ~1t 
would, therefore, be premature to advocate any particular 
approach to the conceptualizing of classroom teaching 


earning activities. 


Presdgercrrlceh ila 

Presage criteria, which assume predictive power 
and which include such teacher characteristics as person- 
ality, training, experience, intelligence and social skills, 
have been studied to determine a relationship between these 
attributes and teacher effectiveness. Bowers and Soar 
(1962: 310) conducted research to study teacher personality 
and found support for their thesis that: 

Teacher personality traits are important to the 
analysis of classroom interaction, and with the solution 
of certain methodological problems, personality traits 
can be used as covarients in studying classroom 
behavior. 

Fattu (1962) and Flanders (1969) reviewed research 
studies pertaining to teacher presage criteria and teacher 
effectiveness. They observed that the presage criteria of 
intelligence, knowledge of subject matter, cultural 


background, socio-economic status, sex, and marital status 


had no significant relationship to teacher effectiveness. 
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38 
Effective teaching was found to be related to teacher 
scholarship in college, professional preparation, age and 


experience, and attitude to teaching. 
SUMMARY 


An enormous amount of research has been Renateea 
into teacher effectiveness since the turn of the century. 
The amount of research and opinion concerning this area 
has increased in recent years because of the increased 
emphasis on accountability and the quality of education. 
Yet, the literature available continually points to the 
problems associated with the evaluation of teachers. 

The difficulty of evaluating teacher effectiveness 
arises from the problems associated with (1) defining good 
teaching, teacher effectiveness, and teacher competence; 

(2) studying human phenomena which are complex and which 
vary from situation to situation and from individual to 
individual; (3) investigating an area of study where little 
conclusive evidence has been provided by research studies; 
(4) maintaining objectivity when evaluation is carried out; 
and (5) determining the evaluative criteria and measurement 
techniques. These problems have caused teachers and 
researchers to question the validity and reliability of 
teacher evaluation. 

Attempts to determine who should evaluate teachers 


are often frustrated by the contradictory research findings 
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39 
and opinions. They range from external evaluators to 
Students. On balance, however, it would appear that 
teachers should be evaluated by more than one person with 
the teacher's principal as one of the members of the 
evaluation group, and that the evaluators must have adequate 
training, preparation, and time for this task. 

The most common methods of evaluation are rating 
scales and systematic observation. Although these methods 
have inherent strengths and weaknesses, the increased 
tendency to supplement these techniques with rigorous 
observer training and the use of audio-visual recorders 
has helped to eliminate some of the weaknesses. 

The criteria on which teachers are to be evaluated 
are as numerous as the research studies which have attempted 
to establish them. The evaluative criteria may be 
classified as product (concerned with changes in students), 
process (concerned with the teaching process), or presage 
(concerned with teacher characteristics). Although there 
is no consensus as to which criteria category should 
receive the greatest weighting, it would appear that 
increased attention is being given to teacher character- 


istics and behavior, and to teacher-—-learner interaction. 
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Chapter 3 
THE DESIGN OF THE STUDY 
SYNOPSIS OF THE PROBLEM 


Whatever the reasons for evaluating teacher 
effectiveness, teachers are evaluated by various personnel 
involved in education and on the basis of evaluation 
criteria determined by personnel external to the actual 
teaching situation. In this evaluation process, teachers 
are seldom consulted about the personnel who evaluate them, 
nor are they involved in determining the criteria on which 
they are evaluated although their personal welfare and 
professional development are at stake. 

This study attempted to examine the views of teachers 
in an urban Saskatchewan school district, at one point in 
time, regarding (1) the existing and preferred evaluation 
personnel, and (2) the existing and preferred evaluation 
criteria. Through a survey of these views, the similarities 
and differences between the perceptions of existing and 
preferred personnel and criteria could be determined. The 
emphasis placed upon each of Mitzel's three categories of 
process, product, and presage criteria in the existing and 
preferred situation could also be established and a 
comparison of the emphasis placed upon these categories 
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4l 
could be made. 

This study also attempted to identify any relation- 
ships which existed between existing and preferred personnel 
and personal and professional teacher variables such as 
level) of instruction, age, sex, years:of teaching experience, 
position held in the school, and years of post-secondary 
education. 

Finally, this study sought to identify any 
relationships between existing and preferred criteria and 


the selected teacher variables listed above. 


THE INSTRUMENT 


The instrument, which is included in Appendix A, 
consisted of four sections: 
I. Personal and Professional Data Questionnaire 
II. Existing and Preferred Evaluators (Two parts) 
III. Existing and Preferred Evaluation Criteria (Two 
parts) 
IV. Comments on the Evaluation of Teachers and/or the 

Study. 

Section I asked seven questions of teachers 
pertaining to the name of the school in which they taught, 
level of instruction, age, sex, length of teaching and/or 
administrative experience, position held in the school, and 
the years of post-secondary education. 

A definition of evaluation followed Section I of 


the instrument (see Appendix A). The definition was given 
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to provide teachers with a common frame of reference when 
responding to the remainder of the instrument. 

Section: ID) consisted: of two parts. The first of 
these parts related to existing evaluators. Teachers were 
asked to score the nine types of personnel which may be 
involved in evaluating teachers according to their 
perception of the extent to which each type of personnel 
is used in teacher evaluation. The second part related to 
preferred evaluators. Teachers were asked to score the 
nine types of personnel which may be involved in evaluating 
teachers according to the extent to which each type of 
personnel should be used in teacher evaluation. 

The numerical scale on which evaluation personnel 
were to be scored was the same for both parts with the 
numbers signifying: 

5. always used 

4. frequently used 

3. undecided about extent of use 
2. seldom used 

1. never used 

O. do not know extent of use. 

The types of evaluation personnel selected for 
inclusion in the Existing and Preferred Evaluators section 
of the instrument were drawn from the literature on the 
evaluation of teachers and from information received 
from colleagues. 


Section III also consisted of two parts. On the 
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first of these parts, which related to existing evaluation 
criteria, teachers were asked to score thirty criteria 
which may be employed in teacher evaluation according to 
their perceptions of the importance that each criterion is 
given in teacher evaluation. On the second part, which 
related to preferred evaluation criteria, teachers were 
asked to score the same criteria according to the 
importance that should be given to each criterion in teacher 
evaluation. 

The numerical scale on which the evaluative criteria 
were to be scored was the same for both parts with the 
numbers signifying: 

5. very great importance 

4. great importance 

3. undecided about importance 
2. aac tulveiimporcance 

1. no importance 

O. do not know importance 

The criteria of evaluation used in the Existing and 
Preferred Evaluation Criteria section of the instrument 
were prepared by Moore and used in his study. Moore 
(1966:30) stated: 

This instrument contained a list of thirty criteria 

drawn from the literature on the evaluation of teachers. 
The criteria were selected for inclusion on the 
instrument after a pilot study had been carried out to 
isolate ten in each of the categories suggested by 


Mitzel; that is, Product, Process and Presage criteria. 


The product, process and presage criteria grouped 


ES 


-" 


noitsulsvs. pritetxs jos bodsler igre 
siietixo YITEGS, Ba998 oF bsdea oxaw aie pons 
ot paibiocos aottsufave tedeses ai beyolqme ed yen Aokaw 
st aotassino dose tadt eons soqnt Yeas to enoitqeoteq tet 
foidw \djisq booose eft 10 .notveoleve wedose? ni asvig 
si9w siedosst ,stistiao notterfisve Betistesd of beseiex 
edt o¢ pnibiesss siazstixap smse sid Szose of Hades 
isdose3 nt noitatiao dose ot sevip sd Bivona sedd sonsasogmt 
-noitsulsvs 

stistixzo svissulseve eft doidw so olsoe Isotitemia sat 








oft dtiw etisq dsed 102 ease oft ssw beaoss od oF etew 
tpiiytiaple atedaon 

sonsiiegmi tse yiov .2e 

eorasiogm: tsemp 

sonsszogmi juods bebioshrin wt 

sonstiogmi sissil iS 

L esonsisiogmt on «ft 

sonsti0gm: wood gon ob .0 

boas pnisaixe edd ot bseu noizauleve 2 sitesiao oft 

tremuisenk sit to moidose sitettad foitsulsva bexwrete1d 


St0oM .ybute ain oat’ beet bas e100m yd beisqs1q o1ew 
: hanged 





; 
| 
| 
. 
| 
; 
; 







44 
by Moore according to Mitzel's categories (Appendix B) 
were listed alternately to prevent teacher bias in 
responding to the criteria in any one category. 
Section IV of the instrument invited teachers to 
make any additional comments regarding the evaluation of 
teachers, the personnel employed for evaluation, or about 


Ene scudyeiteseia. 


COLLECTION OF DATA 


Source of Data 

The instrument was distributed to the 468 teachers 
in an urban Saskatchewan separate school district, whose 
superintendent had given approval for the study, to 
discover their perceptions of existing and preferred 
evaluation personnel and criteria at one point in time. On 
the assumption that personal contact would increase the 
percentage of instrument return, the co-operation and 
assistance of the principals was solicited. A brief 
explanation of the purpose and design of the study was given 
at a school system administrators' meeting at which central 
office personnel, principals and vice-principals were 
present. At this meeting a package of envelopes containing 
an instrument and a covering letter for each teacher in 
each school, as well as a covering letter to the principal, 
was distributed to each principal. The covering letters 
requested completion of the instrument and assured 


participants that individual responses would be treated in 
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confidence but that consolidated findings would not be 
subject to this condition. Principals were asked to 
distribute these envelopes to their teachers, to collect 
the completed instruments, to enclose them in the stamped, 
self-addressed envelope provided, and to forward them to 
the researcher. 

After an elapsed time period of three weeks, 
follow-up letters were sent to the principals who had not 
forwarded the instruments from their schools. 

A copy of the covering and follow-up letter to the 
principals, and a copy of the covering letter to the 
teachers is included in Appendix A. 

All questionnaires returned were checked for inter- 
nal consistency. Table 1 presents an analysis of returns. 
The high percentage of return (81.6) was seen as an 
indication of the interest of teachers in the personnel 


and criteria involved in evaluating teacher effectiveness. 


Table 1 


Classification of Responses to Questionnaires 
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Classification Number Percent 
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Returned, but not usable 35 TES) 
Not returned 86 18.4 
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Personal and Professional 
Data 


Table 2 presents information concerning the 
respondents. Since there were infrequent responses to 
some of the items, the data collected on this section of 
the instrument was collapsed into the categories indicated 
on the table. The number of teachers in each of the grade 
level categories was approximately equally distributed with 
the greater number of teachers (28.0%) in the grade 10-12 
category and the lesser number of teachers (212 3%)) ta the 
grade 7-9 category. More than half the teachers (56. 2%) 
were thirty years of age or younger; more than half (56.8%) 
were female; more than half (66.3%) had fewer than ten years 
teaching experience with the majority of these teachers 
falling into the 3-9 years experience category; more than 
half (55.3%) had completed four or more years of 
post-secondary education. The majority of teachers (85%) 


were classroom teachers holding no administrative position. 


Statistical Procedure 

Data analysis was performed using the IBM 360/67 
computer and programs documented by the Division of 
Educational Research at The University of Alberta. 

In analyzing the data from Section II of the 
instrument, a frequency count was used to place evaluation 
personnel in rank order for the existing and preferred 
evaluation situation according to the percentage of 


"frequently" and "always" responses. This enabled the 





oe 


oft pataasonas not dems ak roe nth. ; 

oF aeenoges1 Jasvpeiidat eisw Ssisd? some psec 

to noijos2 aid? oo bsjoolloo 5366 sit \emett afd 2o emoe 
betsotbat estiopsiso sit otal besgellon eow Jiemuateat ane 
sbs1ip aft to doses ni exsdosed to asdmua sd? -sids63 edt no 
djiw betudiasteib yifsups ylotamtxowggs esw estiopssso Level 
S{-Of sbsip odd ot (80,88) exerdsses to qedmum sedeeap ent 
oda ot (XE .18) exzsdosex to 1edmuc asae9i sft, Reve yiopsss5 
(WS.62) areifosed oft 34sd needa oacM /YIopstso0 &-T 9bs1p 
(N8.0¢) isd asit siom :1spauoy 10 Ssps Zo sissy YIridd stew 
sissy mot asdy igwo2t bed (KE.d0) Iled nsds exom solanet Si19Ww 
atenfosst seodt io yiisotem snd fjiw sonsbisqxs eninoset 
nsit stom .yiopsts5o spnehisqxes ezsey ©-€ sd? ofak pnslls2 
ic e1sey S7om 10 iv0t Betelamos bat (Re .ce) tied 

(NCB) exorose? to yii1o(smienT .nolssoubs yisbposse-deem 
sMoitiaoqg svi errr on paiblod ersdoses mooreesio Siew 


TA\OCE MBI sit pniew bami0t19q esw ateylens stad = 


20 noteivid ona « besnemaob es 









47 


0°Sss 
JeypeeL, prey 


Gre 


Gal & ee 


RZueunzzedeq Tedtoutad-sotA Tedtoutszd 


pTey uoTzTsog 








8°L A Xd € O72 aca O°ZE 
oezoU IO 9 G P € SSOT to Z uotT}zeonps ATepuodes—-y3Ssod Jo sireazZ 
O°ET L072 T° 8P Z°ST 
oIToUl IO 0QZ 6T-OT 6-€ SsoT 10 Z eoduetTIedxe Hutyore} FO SrAeaZ 
8°9S CECT 
oTeus 7 OTON x9OS 
T°8 eet TEC Z°9S 
JeA0 8% TG OS-T? OPaTE zepun ¥ OF oby 
0°8Z Gaaet c a IY A VaLe 
COT 6a 9-F Ses! UuOTIONAASUT FO TeAEeT 
set1z0be3e9 STQetrzean 
LYE=N 


(sobejusoteq Aq satouenbel7) 
eR2eq TeUOTSSSFoIg pue TeuOSIed 


f 8TAeL 








eesl 10 fnolttsoubs 


8.f gas é.es trot O.SE 





aedsssT beso gnsmdisqead Isqiszaiig-s0tV Lsqisnti9 
0.¢8 $.2 £.€ 0.90 





vs 


48 
determination of teachers' perceptions of the extent to 
which each type of personnel is used and should be used 
in teacher evaluation. 

The rank ordering of evaluators for the existing 
and preferred situation enabled comparisons to be made of 
the evaluative role of each type of personnel in each of 
the situations. 

The Spearman rho correlation from ranks was 
calculated to determine whether or not any overall 
difference existed between the two different situations 
and the ranking of the evaluation personnel as perceived 
in the two situations. 

Chi square tests were used to ascertain whether 
Significant relationships existed according to specific 
categories of the six personal and professional data 
variables. An alpha level of .05 was used as the confidence 
level to indicate that significant relationships existed. 

A similar statistical procedure was used for 
Section III of the instrument. The criteria were placed 
ine oenk Order for both Existing and prekerred Situations 
according to the percentage frequency of "great importance" 
and "very great importance" responses thereby enabling 
the determination of teachers' perceptions of the 
importance that each criterion is given and should be given 
in teacher evaluation. 

The rank ordering of criteria used in evaluation 


for the existing and preferred situation enabled comparisons 
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to be made of the importance, given to individual,» criteria 
in each of the two situations. A difference in rank of 
seven or more was arbitrarily selected as an indication of 
a substantial difference between the two situations. 

The Spearman rho correlation from ranks was 
calculated to determine whether or not any overall 
difference existed between the two different evaluation 
Sieuations and the tanking of all thirty criteria as 
perceived in the two situations. 

When the thirty criteria, ranked according to 
frequency, were classified according to Mitzel's process, 
product, and presage categories, it was possible to compare 
the emphasis placed upon these criteria categories in each 
evaluation situation. 

Chi Square tests were used to ascertain whether any 
significant relationships existed according to specific 
categories of the six personal and professional data 
variables. An alpha level of .05 was used as the confidence 
level to indicate that significant relationships existed. 

It was recognized that in some of the tables there 
was a probability that the chi square was inflated since 
the expected frequency in more than twenty percent of the 
cells was less than five. A separate computer program on 
collapsed responses was run to determine that the chi 
square was still significant but the data was presented in 
its original form to show the distribution of responses. 


Comments regarding the study, invited in Section 
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Iv of the instrument, were classified under the following 


headings: 


1. General reaction to the instrument 
Pe iva liiatvon personne. 
be Evaluation criteria 


4, Frequency of evaluation 


Be General comments. 


LIMITATIONS AND DELIMITATION 


Limitations 

The limitations of this study were as follows: 
1. This study was limited to the nine types of personnel 
who might fulfill the evaluation of teacher effectiveness 
function in Saskatchewan. 
2. It was limited to the thirty evaluative criteria 
developed and tested by Moore (1966) and used by Thomas 
(1969) and Rogers (1970) in their studies of teacher evalu- 
ation. No attempt was made to alter or modify the criteria. 
3. The findings of this study were limited to the 
population involved and generalizations to other school 


systems cannot be made. 


Delimitation 
This study was delimited to the perceptions of 
teachers, at one point in time, in the urban Saskatchewan 


school district selected for this study. 
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Chapter 4 
EVALUATION PERSONNEL 


One of the purposes of this study was to discover 
the perceptions of teachers in an urban Saskatchewan school 
district regarding the extent to which each of the nine 
types of personnel listed for scoring is used and should be 
used in the evaluation of teacher effectiveness, and to 
identify any existing relationships between these 
perceptions and the selected personal and professional 
variables. 


PERCEPTIONS OF EXISTING AND PREFERRED 
EVALUATION PERSONNEL 


Existing Evaluation 
Personnel 

For this part of the instrument, teachers scored 
nine types of personnel which may be involved in evaluating 
teachers according to their perceptions of the extent to 
which each type of personnel is used in teacher evaluation. 
Each of the nine types of evaluators was scored on a six 
point numerical scale signifying: 5. always used; 4. 
frequently used; 3. undecided about extent of use; 2. seldom 
used; 1. never used; 0. do not know extent of use. 

Table 3 ranks these types of personnel according to 
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52 
their use, "frequently" and "always," in evaluating teachers. 
The majority of respondents perceived two of the nine types 
of evaluators to be "frequently" or "always" used in 


evaluating teacher effectiveness. 


Table 3 


Frequency of Mention of Personnel 
Employed for Evaluating Teacher 
EELectiveness 
N=347 


—$<klllTl—lm—LhL—L—LeaQ])])alap])phphLhLhLLhLhpbUl]_]lL——— SL — —L— _— — — L_SSS==S==_=_—_—=—=—====_—-==_L___qqq— 


Percentage Response 





Rank Personne: 
Fa ab Total 
ut School Board Superintendent 44.7 39.2 Ss. 9 
2 School Principal LAST 3020 74.7 
5 Central Office Administrative 
Group 31.4 5.8 Se! 
+ Department Head 15.0 4.3 Wiehe S) 
5 Provincial Department of 
Education bg i) bl 5 32 
6 Students Sips) id 8.6 
i Self 536 PS2Z 1.0 
8 Provincial Teachers' Organization 6.1 OFS 6.4 
9 Colleagues 4.6 Le 5¥6 





4rrequently used. 


Palways used. 


The School Board Superintendent ranked first; 
eighty-four percent of the respondents perceived him to be 


"frequently" or "always" used in evaluating teachers. The 
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oo 
second ranked evaluation personnel was the Principal who 
Wasgiper cenved’ tombesused "frequently" or "always" by 
seventy-five percent of the respondents. All other types 
of evaluators were perceived to be "never" or "seldom" 
used in evaluating teacher effectiveness by the majority of 
teachers. 

Preferred Evaluation 
Personnel 

For this part of the instrument, teachers scored 
nine types of evaluation personnel according to their 
perceptions of the extent to which each type of personnel 
should be used in teacher evaluation. Each of the nine 
types of personnel was scored on the same six point 
numerical scale indicated above. 

Table 4 ranks these types of personnel according to 
their preferred "frequently" and “always" use in teacher 
evaluation. The majority of the respondents preferred two 
of the nine types of evaluators to be "frequently" or 
“always” used in evaluating teacher effectiveness. 

Tne Principal rankedsiirsteamong preberreda 
evaluators, and was preferred to be "frequently" or "always" 
used by the majority (78.7%) of the respondents. The next 
ranked preferred evaluator was the Superintendent with 
fifty-eight percent of the teachers indicating that he should 
be "frequently" or “always” used in evaluating teachers. 


The majority of the teachers preferred the other types of 
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54 
evaluators to be "never" or "seldom" used in evaluating 


teacher effectiveness. 


Table 4 


Frequency of Mention of Personnel 
Preferred for Evaluating Teacher 


Effectiveness 
N=347 
ee 
Percentage Response 
Rank Personnel aa. .  COCtS”S*C~C=ti‘CS 
Ie ab Total 
pe eee ene ee ee ee ee ee 
1 School Principal A8h7, 38010 13.7 
2 School Board Superintendent A5Q0 2RT237. Blow 
5 Department Head 32¢6s8el47t 46.7 
4 Self 30.8 10.4 41.2 
5 Central Office Administrative 
Group 2S), Ti Ga 36.0 
6 Colleagues 28.0 6.6 34.6 
7 Students Reis) Ons 30.2 


8 Provincial Teachers' Organization 21.3 eS) PLIERS 


9 Provincial Department of 
Education bil so L.4 12.4 


8 


@Frequently used. 


Palways used. 


COMPARISONS OF EXISTING AND PREFERRED 
EVALUATORS 
The rank ordering of evaluators for the existing 
and preferred evaluation situation enabled comparisons to 


be made of the evaluative role of each type of personnel in 
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20 
each of the situations. 

Table 5 presents the rank order of the evaluation 
personnel perceived to exist and preferred by teachers as 
well as the difference of their role in the existing and 
preferred situation. The highest ranked existing 
evaluator--the Superintendent--ranked second as preferred 
evaluator. The second ranked existing evaluator-—-the 
Principal--ranked first as preferred evaluator. 

The greatest differences in rank pertained to the 
Provincial Department of Education Personnel, Self, and 
Colleagues. Teachers preferred to have Provincial 
Department of Education Personnel play a lesser role in 
evaluating teachers, but they preferred increased emphasis 
on Self-evaluation and evaluation by Colleagues. 

The Spearman rho was calculated and was found to 
be .65. This value suggested that there was a positive 
correlation between the existing use of the listed 
evaluators and the preferred use of these evaluators; that 
is, the evaluation personnel perceived to play a major 
role in the existing situation tended to be perceived to 
play da major role in the preferred situation and, conversely, 
evaluation personnel perceived to play a minor role in the 
existing situation tended to be perceived to play a minor 


role in the preferred situation. 
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57. 
RELATIONSHIPS BETWEEN CHARACTERISTICS OF 
RESPONDENTS AND THEIR PERCEPTIONS OF 
EXISTING EVALUATION PERSONNEL 

One of the purposes of this study was to determine 
whether any significant relationships existed between 
teachers' perceptions of existing evaluation personnel and 
six personal and professional variables. The six variables 
were as follows: level of instruction; age; sex; years of 
teaching experience; position held; years of post-secondary 
education (see Appendix A). 

Since there were infrequent responses to some of 
the response categories of the six variables, the data 
collected was collapsed into the following response 
categories: Level of instruction--all respondents in the 
"do not teach" category were high school teachers and were 
placed into the 10-12 category; Age--(1) 30 and under, 

(2) 31-40, (3) 41-50, (4) 51 and over; Years of teaching 
experience--(1) 2 or less, (2) 1929)6(3)) 10si9;10(4)n20 cor 
more; Years of post-secondary Education=+2(b)je2 oprbess, 
(zgpagen(3ay 4p ¢4)157005)) Ghon more: 

Since this study was interested in the perceptions 
of teachers who had knowledge or views regarding evaluation 
personnel, the "do not know" response category was omitted 
from statistical analyses. 

A chi square test was performed to determine 
relationships between each of the six variables and the 


teachers' perceptions of evaluators. These relationships 
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58 
were accepted as being significant at the .05 level or 
less. Significant relationships were found in fourteen 


instances and are presented in Tables 6-11. 


Level of Instruction 

Table 6 shows that significant relationships 
existed between the level of instruction variable categories 
when responding to five types of personnel used in teacher 
evaluation. The five types of evaluation personnel were 
as follows: (1) Provincial Department of Education 
Personnel; (2) A group of Central Office Administrators 
and/or Supervisors; (3) Principal; (4) Department Head, 
Grade Co-ordinator, or Curricular Associate; (5) Students. 

Grade 10-12 teachers more often perceived 
Provincial Department of Education personnel to be more 
frequently used as evaluators than did teachers at Ene 
other levels of instruction. 

Teachers at the lower levels of instruction tended 
to perceive an Administrative Group to be used more 
frequently as evaluators than did teachers at the higher 
levels of instruction. 

Grade 7-9 and 10-12 teachers more often indicated 
that the Principal was infrequently used in teacher 
evaluation than did teachers of the other grades. 

Grade K-3 and 10-12 teachers tended to perceive 
Department Heads to be used more frequently in teacher 


evaluation than did teachers of the other grades, and 
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61 
teachers at the lower levels of instruction tended to be 
more undecided about the role of Department Heads than the 
teachers at the higher levels of instruction. 

Students were perceived to be more frequently used 
as evaluators at the higher levels of instruction than at 


the lower levels of instruction. 


Age 

Table 7 shows that a significant relationship 
existed between the age of the respondents and one of the 
types of evaluation personnel listed, namely, the 
Provincial Department of Education Personnel. 

Examination of the data indicated that older 
teachers tended to perceive Provincial Department of 
Education Personnel to be used more frequently in evaluating 


teacher effectiveness than did younger teachers. 


oex 

The three significant relationships between the 
sex of the respondents and perceived evaluators are 
presented in Table 8. The three types of evaluation 
personnel were the Superintendent, an Administrative Group, 
and Students. 

Female teachers tended to perceive the Superin- 
tendent to be "always" used in teacher evaluation whereas 
male teachers tended to see the Superintendent to be 
"frequently" used. 


Males tended to perceive an Administrative Group 
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64 
to be used infrequently as evaluators whereas females 
tended to see such a group to be frequently used. 

Male teachers tended to perceive Students to be 
used more frequently in teacher evaluation than did female 


teachers. 


Years of Teaching 
Exper lence 


Table 9 presents the significant relationships 
between the years of teaching experience variable and 
perceptions of evaluation personnel. The two significant 
relationships pertained to personnel from the Provincial 
Department of Education and from the Provincial Teachers’ 
Organization. 

Provincial Department of Education Personnel were 
perceived to be used more frequently by teachers with more 
years of teaching experience than teachers with fewer years 
of teaching experience. 

Teachers with twenty or more years of teaching 
experience more often indicated that Provincial Teachers' 
Organization Personnel were frequently used as evaluators 


than did teachers with less teaching experience. 


Position Held 

Significant relationships existed between the 
position held variable categories when responding to two 
types of personnel used in teacher evaluation, namely, 


an Administrative Group and Students. These relationships 


48 














eofenst el ol ccbencaai ae idee ‘tak Bi z 
beau ylineiiper? ed wie wae 2s pasting 
ed ot evaspuse svisoisq ot Bsbast exetoses Lat 


alamet bib aedt+ solssenleve aeriogst at heeaasi ey 






eqidencitsis1 tnsoliinptea sds atnsasaq © older 


‘+ 


bas a tel sonelisqxe poifiose? Fo ausey ods neowsed 
tnsoLtiapte ows sAiT .Isnmoeiseq notteu lave io enots 18q 


{sfontvord sit moxt Lerimoeisq oF bentstisq eq flex 
‘'eisdoseT LIsionkyord sft mo1t bas Ri ig to song ; 
s1i9ew Loennoei1s9 not 6oubs to Irtemstseqed tence | 

siom Mtiw aiedoses yd yivasypss2 esom pope. - os 





aisey i9we? ddiw etedvsst cede sonsi1eqxe | 


pninosst to e1iBsy si0Mm sO Yooows asi — 
‘'eresrdossT L[stonivord tsd3 bedsoibat aesto oxen 
estossulseve Ey bsexu yidnoupes? atew y sania hak 
sjpibisirieeeine paidoset pot anal sistw 


i 


= 


Pay 


65 


Ge santas OF OT JARS 

0°O 9°9 Z°8 T°?S 
092 qt’ “cz 

0°O 9°8 64 0T Sect 

0°O 6°? 1 Geel Vave 

ley ae Onac €°8s AG 

9 at E567 lea © OL O°T? 
6SZ me LE 

8°0O Catt 8°6 Levy 

O40 sea Galt Sec 
N ezenbs sAemtyw ATRuenbezq peptosepun woptes 


TUDO 


°SSOT IO [TSAeT Go’ euz 3e QUeOTITUBTS 


q 


*SSOT JO TeAeT TO* eu Ae queoTsTubTsS, 


setziobs}ze9 esuodsey 


ISAON 


STOW IO OZ 


61-07 
uoOTReZTURHIO 
, STSyoORSL 6-E£ 
SSOT 10 Z 
eIOU IO OZ 
uoTzeonpyA 6T-OT 
jo 

RueuAredaq 6-E 
SSeT IO Z 
eoueTtredxq 

Teuuosieg JO szeaeZ 





(mot Aq ob6ejuselI70d) 
Teuuosiseg UOTReENTeRAG JO 9SN pPeATSdASeg pue 


SsoueTrsdxq Hutyorey Jo sreaR udseM}ROG SATYSUOTReTSY RZUeOTFTUHTS 


6 eTdeL 





¥.0£ 


.229l 10 {evel I0. sat ge 3asoi2 


-eeof 10 fovel 40. sat 35 Jnsorse 


66 
are presented in Table 10. 

Department Heads tended to perceive an Adminis-— 
trative Group to be used less frequently as evaluators 
than did teachers in other positions. 

Principals tended to perceive Students to be never 
used in evaluation whereas teachers in other positions 
tended to perceive them to be used to some extent. 

Years of Post-secondary 
Education 

Table 11 shows that a significant relationship 
existed between the years of post-secondary education 
variable and teachers' response to Students as evaluators. 
The nature of the relationship was not clear, but it 
appeared that teachers with two or less years of 
post-secondary education tended to perceive Students to be 
used less frequently as evaluators than did teachers with 
more than two years of post-secondary education. 

RELATIONSHIPS BETWEEN CHARACTERISTICS OF 
RESPONDENTS AND THEIR PREFERRED USE 
OF EVALUATION PERSONNEL 

This study attempted to determine whether significant 
relationships existed between teachers' preferred use of 
evaluation personnel and the six personal and professional 
variables. 

Since infrequent responses were evidenced in some 
of the response categories of the six variables, the data 


was collapsed into the response categories indicated above. 
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69 
As in the previous section, the "do not know” 
response category was omitted from the statistical analyses. 
A chi square test was performed to determine 
relationships between each of the six variables and teachers' 
perceptions of the preferred use of evaluators. these 
relationships were accepted as being significant at the 
.05 level or less. Significant relationships were found in 


fourteen instances and are presented in Tables 12-17. 


Level of Instruction 

Table 12 shows that significant relationships 
existed between the level of instruction variable 
categories when teachers responded to six types of 
preferred evaluators. The six types of evaluators were as 
follows: (1) Provincial Department of Education Personnel; 
(2) Provincial Teachers' Organization Personnel; (3) an 
Administrative Group; (4) Department Heads; (5) 
Self-evaluation; (6) Students. 

Grade 10-12 teachers tended to prefer Department 
of Education Personnel to be used more frequently as 
evaluators than teachers at the lower grade levels. 

Teachers at the higher levels of instruction 
tended to prefer the Provincial Teachers' Organization 
Personnel to be used more frequently in teacher evaluation 
than did the teachers at the lower levels of instruction. 

Grade K-3 teachers tended to prefer an Administrative 


Group to be used more frequently than teachers at other 
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72 
grade levels. 

Teachers at the lower levels of instruction tended 
to prefer infrequent use of Department Heads as evaluators 
whereas teachers at the higher levels of instruction 
tended to prefer that they be frequently used. 

K-3 teachers more often indicated a preference 
that Self-evaluation not be used than did teachers at the 
other levels of instruction. 

Teachers at the higher levels of instruction tended 
to prefer greater use of Students as evaluators of 
teachers than did teachers at the lower levels of 


instruction. 


Age 

Table 13 shows that a significant relationship 
existed between the age of the respondents and the preferred 
use of one of the types of personnel listed, namely, 
Provincial Teachers' Organization Personnel. Although 
the chi square was significant at the .05 level or less, 
the nature of the relationship between the age of the 
respondents and the preferred use of Provincial Teachers' 
Organization Personnel in the evaluation of teacher 


effectiveness was not discernable. 


sex 
The three significant relationships between sex and 
preferred evaluators are presented in Table 14. The three 


types of personnel were Department Heads, Self-evaluation, 
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mS 
and Students. In responding to each of the three types of 
evaluation personnel, male teachers tended to prefer 
Department Heads, Self-evaluation, and Students to be used 
more frequently in teacher evaluation than female teachers 
SKS ie 


Years of Teaching 
Experience 


Table 15 presents the significant relationships 
between the years of teaching experience variable and 
teachers' preferred use of one of the evaluation personnel 
listed, namely, Provincial Department of Education 
Personnel. Teachers with two or less years of teaching 
experience tended to prefer that Provincial Department of 
Education Personnel never be used in evaluating teachers 
whereas teachers with more than two years of teaching 


experience tended to prefer some use of these evaluators. 


Position Held 
The significant relationship which existed between 

the position held variable categories when teachers 
responded to preferred use of Self-evaluation is shown in 
Table 16. Although this relationship was found to be 
significant, the nature of the relationship was not 
discernable. 
Years of Post-secondary 

Education 


Table 17 shows that significant relationships 
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existed between the years of post-secondary education 
variable and teachers' response to use of Department Heads 
and Students as evaluators. 

Teachers' preference for frequent use of Department 
Heads as evaluators tended to increase with an increase 
in the number of years of post-secondary education. The 
exception to this tendency was the teachers with six or 
more years of post-secondary education who tended to be 
more undecided about the preferred use of Department Heads 
as evaluators than the other teachers. 

The relationship between years of post-secondary 
education and the preferred use of Students as evaluators 


was not clear. 
SUMMARY 


The majority of teachers perceived their School 
Board Superintendent and their Principal to be "frequently" 
or "always" used in evaluating teacher effectiveness. They 
also preferred that these personnel be used "frequently" 
or "always" in teacher evaluation. However, they preferred 
that the Principal be used more extensively as an evaluator 
than the Superintendent. The majority of teachers perceived 
the other personnel listed for scoring to be “never” or 
"seldom" used as evaluators, and preferred that they be 
used to this extent. 

When a comparison of the evaluative role of the 


listed personnel in the existing and preferred situation was 






noitsesbe viebnopen-saog te. satay os TOSW 
abso soamtisqed to eeu oF senogess doi | 
-axoseu Lave as 
trems1eqod Xo say So a soft sonsietesg, *eretfoset | 
easoionk as dtiw sesetont ot Bebra a103euLeve io anad é 
aft .coltsoubs Yisbnoves—se0q tO ansey To siatneeate odd nk 
to xia dtiw eaasdoses ond esaw yorebriss ‘eidt of noliqeoxe 
ed od beboex ondw ‘noidsouse visbnosea- daeq to e3aey e10Mm 
ebsoH smamtxsqed to sey bertetexq end duos bsbivsbnw 10m 
-sr19fcees sasdito ey neds exoseuleve as es 
yuisboonea-sJeog to assy neswited gidenotssier edt 3 


o 


eitotsulsve as estasbus® to seu bexwretete ens bas pa baa 


a - 


Loorine ukLedt bevieorsg ausrioset to. yeiaoien oat 
"vyitaerpett" od oF feqioniad aiedts bas snebnosatreque bisod - 
youT .agsnevistoelis tsdoses patceuleyve: ar peu "ayewis" 10 

“yloneypert" boas ed ennoareq eeedt sects hshootiohag oals 
beinsterzq yous yes -nolistsyisve wetipsst mi “ayewss" 10 
totsulevs 6 25 vievienssxe stom bene! sd ee 
hevisosed exsriones 30 yais0bem ae ony ae 








} 
; 
| 

; 


80 

made, no overall difference was found. 
Fourteen significant relationships between the 

characteristics of the respondents and their perceptions 
of the existing use of evaluation personnel were found to 
exist. Five of these relationships pertained to the level 
of instruction variable. Fourteen significant relationships 
also existed between the characteristics of the respondents 
and their preferred use of evaluation personnel. Six of 
these relationships pertained to the level of instruction 


variable. 
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Chapter 5 
EVALUATION CRITERIA 


One of the purposes of this study was to discover 
(1) the perceptions of teachers in an urban Saskatchewan 
school district regarding the importance given to each of 
Chewuntabyecl 1 teriawitstea for scoring in the existing 
evaluation situation, (2) the importance that each of 
these criteria should be given in the evaluation of teacher 
effectiveness, (3) the emphasis placed upon process, 
product and presage criteria in the existing and preferred 
Situation, and (4) relationships between the selected 
personal and professional variables of the respondents and 
their perception of existing and preferred criteria. 


PERCEPTIONS OF EXISTING AND PREFERRED 
EVALUATION CRITERIA 


Existing Evaluation 

Criteria 

For this part of the instrument, teachers scored 

thirty criteria which may be used in teacher evaluation 
according to their perceptions of the importance given to 
each criterion in the evaluation of teacher effectiveness. 
Each of the thirty criteria was scored on a six point 
numerical scale signifying: 5. very great importance; 4. 
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82 
great importance; 3. undecided about importance; Zee 
importance; 1. no importance; 0. do not know importance. 

Table 18 ranks these criteria according to the 
"great" and "very great" importance given to them in 
teacher evaluation. Sixteen of the thirty criteria were 
perceived to be given "great" or "very great" importance 
by the majority of respondents. 

The criterion Class Control ranked first; it was 
perceived to be given "great" or "very great" importance 
by eighty-four percent of the respondents. Ranking second 
was the criterion of Lesson Preparation and Planning 
(80.2%) and third was The Energy, rors and Enthusiasm 
Displayed in Teaching (72.4%). It was concluded that 
teachers perceived the present concept of an effective 
teacher to be one who has class control and well-prepared 
and well-planned lessons, and who displays energy, force 
and enthusiasm in teaching. The fourth ranked criterion 
was the teacher's Academic Qualifications and Knowledge of 
the Curriculum (66.6%); the fifth was the Methods of Lesson 
Presentation (66.2%); the sixth and seventh were 
Teacher-Pupil Relationships (63.1%) and Pupil Participation 
in Class (59.7%) respectively. 

The existing criteria perceived to be given least 
importance were The Degree of Self-evaluation of the 
Processes Employed, The Teacher's Participation and 
Standing in the Community, and The Training of Pupils in 


Civic Competence and Responsibility which ranked thirtieth, 
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twenty-ninth, and twenty-eighth respectively. 
Prererreqghvalviatiuon 

Criteria 

Peo Ebicwpabteor Lhiewinstrument, Léeachers scored 
thirty criteria according to their perceptions of the 
importance that each criterion should be given in evaluation 
of teacher effectiveness. Each of the thirty criteria was 
scored on the same six point numerical scale indicated 
above. 

Table 19 ranks these criteria according to their 
preferred "great" and "very great" importance given to 
them in teacher evaluation. The majority of respondents 
preferred that twenty-eight of the thirty criteria should 
be given "great" or "very great" importance. 

The criterion Concern With the All-round Development 
of the Pupils ranked first; it was preferred as a criterion 
given "great" or "very great" importance by ninety-six 
percent of the respondents. Ranking second was the 
criterion of The Energy, Force and Enthusiasm Displayed in 
Teaching (95.1%) and third was Concern with Character 
Development of the Pupils (93.1%). It was concluded that 
the teachers perceived an effective teacher to be one who 
is concerned with the all-round development of the pupils, 
who displays energy, force and enthusiasm in teaching, and 
who is concerned with the character development of the 
pupils. The fourth ranked criterion was Teacher-pupil 


Relationships (91.6%); the fifth was Lesson Preparation and 
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Planning (91.4%); the sixth and seventh were The Provision 
Made for Individual Differences and Group Needs (90.2%) 
and Class Control (87.0%) respectively. 

The criteria which teachers indicated should be 
given least importance were Examination Results, The 
Teacher's Participation and Standing in the Community, and 
The Professional Activities of the Teacher which ranked 
thirtieth, twenty-ninth, and twenty-eighth respectively. 

COMPARISONS OF EXISTING AND 
PREFERRED CRITERIA 

The rank ordering of criteria used in evaluation 
for the existing and preferred situation enabled comparisons 
to be made of the importance given to individual criteria 
in each of the two situations. A difference in rank of 
seven or more was arbitrarily selected as an indication of 
a substantial difference between the two situations. 

Table 20 presents the rank order of the evaluation 
criteria perceived to exist and preferred by teachers as 
well as the difference in importance in the existing and 
preferred situation. The highest ranked existing 
criterion--Class Control--ranked seventh as a preferred 
criterion. The second ranked existing criterion ranked 
second in the preferred situation. The first ranked 
preferred criterion--Concern With the All-round Development 
of the Pupils--ranked tenth as an existing criterion. The 


second and third ranked preferred criteria, namely The 






oe 
fotaivesd SAT sxew dsnavee brs fonts « ont 0 t8) 
(S.00) ebset quoxD bas ees | 
Nidbteneounsiile | ° 
ed bleore betsorbnt ersfoset io .tiiw akvedite est 
eff ,etivaedH mokisninsexd idl eorstiogms deci ip 
bas ,ytirwmmoD eft ai paibasse bas a pererrer t: errotasen 
beAns: doitw wdoseT edt to aeitivisod {snoi oT 






.ylovitoeqes: dtipie-yinswt bas igokoqys awd dongs 


GMA OWLT2LXA TO 2MOBLAAIMOD . . 
ALAATTAD GaAATAaAa Ph 


? 


noitsuLeve at Peay sizetixzo to paiisbie Ans1 oT 


Lae ‘ 

enosixzsqmoo Beldsns cottsutie Bbeiaste1q bas pniseixe orf3 402 
sizesizo Leubivibnt oF mevip sonestogmt eds to ebsm ed 03 | ' 

to. Ansa at aoretsttib & .enoiseutte ows edt to tape mk ‘ 


to noisssibnt as be bstoelee eiuertidis ape etom 10 novos 
eaokteucgie owt Sit esasiaye Sek sonate22tb Isittast r) 
norssulseve edt to 1Sb20 Ansa sti paneeosq OS eidsT 
es arzendoses yd porssieag bows teixe os bovieozeq 5LISILID 
bas pniteixe edd nt sonsstognitk ui somone? tib ont iiew | 
ptitaixe berlin qesdpid 9 ae bo118t92¢ _ 
bexseteag 6 es apne Coa: ) gasf9-—n0t 













ee ap = ia 
: ie " a r| 





va 


spesu dnoizd pue 





rae 9 Z°06 ST Z°GP SOOUSsIOFFJTIP TeNPTATpPUT ACF Spew uoTSTAoIAd sy 
tT . TLes 7a b° SP s{Ttdnd sy} Fo AUusudoTSeAsep ARZOeTeYO YRZIM UASDUOD 

is 6 Oucs oF [eas SJequew Jyeqys ASyAO 
UTM TSeyors} 3yR Aq uoTRZeAedo-od Fo serzbep syyL 
Cort °9Z GGG ST Ge oc Teyores} ey FO soueTeedde pue sseip syL 
T GT 9°9OL PT 9° aC Teyors} ey3 Aq poke{Tdstp dtyszepeset fo satjAtTTend 
(s SL mercy iy” bream Sh Reames tae A spte HbutTyorez Fo 9sn sy 
ST O€ c yet cl L°SS S3Tnset uoTReuTWeXy 
eae (6 L°*sS9 TT v°9S YIOM USzQRTAM JO HuTYyooyo pue uotsTAredns 

6 i 0°96 OT S°9S sttdnd 
9u3 JO ZUeUdOTeASep puUNOA-TTe ey YITM UTsD.UND 
G vI 6°8L 6 v°LS Jeyors} ey Fo ARtTTeuosted SyL 
€ LEeerOseoan'S S°8S Jeyors} ay} Fo AQt{TTqepuedep pue AyTeAoT SyL 
9 ce T° 08 B L°6S sseTo ut uotjzedtotyzazed [tdnd 
Z v 9°16 9 T°€9 sdtysuotjejTer [tdnd-zsyoeeL 
réaf Li agit gy p S Z°99 pesn uot}ejUSeSeId uosseT JO poy jou su 

L Loe O7ES T 9°99 wn [TnNoOTtTrano 
oyun FO eHhpeTmouy pue suotzedTFJTTenb otwepeow 

T Zz v°S6 € GE Hutyore 
ut peAeTdstp wsetsnyujue pue sor0z ‘AHrsue sul 
€ S 7° T6 q Z~°08 Hutuuetd pue uotzerzedeid uossey 
o L 0°48 u 7°78 [Tor}uo0D. ssetO 

syuey ut suey So yUuey Se 
souel19s51Tq — eTI9e34TIAO 


poerzrzeyoid ButyAst xg 








EVEN 


(6T pue ST SeTqeL ated sy) 
PTIOATAO UOTRIENTeAG poerTZezyortg pue HutAstxg_ Fo ATepz0 yuey 


Oc PTAeL 


a am ae. ey. "ay wu te, —_— ww oe ae ee 
a : 








: paca = 
: (OL bor Siesiiot 
= " =K 7 








=e v o.vs- I £.38 
ee e-- pce s = *S.08 piinnsiq £ 
; os mt boysiqeip masteudias bre 
2 S be) ¢€ ~~ best — 
ai Yo agbs [won bas enol 
t if G.t86 . 3.20 3 
gi I @.€T é $.300 Peeu noissie ‘ 
s h &.ie 3 1.£0 _eqidenol 
3 ef 1,06  ~¥.9e | 
é Ii O.£€8 8 @..6é tsrosed ons to ytilidebs aqsb 
é Sr 6@.6T Oe &.T2 rss set = Be 
: etd. 30 tasmqolsveb Door LEB 8 
2 z 0. ae Of 2. 
if $s 2d [ft $.8c Axow astszizw Fo pnt 
Si OE § .61 Si ey ~ 
t os § .voe efi é& sce : 
f ai @.0 8f £@6.&2 istinss3 sft yd beysaigetbd ai 
@.ii é .8s e .c2 ef € .€é isdoss3 oft to o 
fitiw asnhosss sii yo Aor 
vi e 2.£6 ot y.S$e 2x¢ 
o af E r.£e TE 5. 8h efliaquq sit to txemgoleveb ae7 
ed Sf a ¢.0e Si ¢.2h asonsisitib [sybiverbad zo? 


a2 





s’€ G°9Z = 6 “SS O& rele peAoTdus 
sesseco0id 3yuz FO UOTReENTeAS-JFTOES FO serhsp suy 

0 6Z 9°82 6% 8° hz Aj Tununoo 
oyu} UT HuTpuejAs pue uoTRZedTOTAIAed S,ASsyore, SUL 

6 6T 9°OL 8Z P°LZ AjTTTqtsuodse.z 
pue soduejZeduod OTATO ut stTtdnd jo Hututerz3 sus 

OT TT oO°€8 Lae Lace strdnd eyz ut Aaztnbue 
TenptAtput Fo sseooid sy} FO ZUsewdoTSsaep syyL 
Z $Z S26c OZ caGe uoTSTAZedns 4NoYyURTM TTeM YyIom stTtdnd osyy, 

Li ST 6: Ge GG 68 9f Sprepuejs 
Teotyu7ZSe pue Tezow Fo uotzeroeizdde s,{tdnd suy 

T €f #1. ao 72 6°9F AzTAoYyANe 
O03 pue TooYyoOS 9yR oF STtdnd syRz FO Sspnqt 73e SUL 
Goa IZ 6°99 @°-z77 PELE sttdnd ey yztM HuTpueqAs s,zTeyors} sys 
S°PT 8 Bovey eer wer tels uotsseidxe jJTes ut s{ttdnd jo Hbututerzq syyz 
" 32 Aes Tae On CG Tsyoresa} su FO SSTRTATROeS Teuotssszoizd suy 
g Ge 8°9G Om STI? Tayoese} Sy FO SOUSHTTTSeRUT FO TeaseT sys 

€ oF S°SL 61." IM7c7 souet [Ts41a-F [9s 


pue Aaysnput ‘AsajzaAnood Fo ssepnzTt73e TItdng 





yuey ut yUueY % yUuey % 
s2uSie33—5q ee eTAISeATIAO 
peirzejeidg Butystxy 





(penuT}UOD) OZ eTqeL 





tiee ee ee 


_ * aliquq od? f 
_— 23 ot bas Loobe sit o3 eliquq 9 
{ €¢ T.£8 £5 @.3€ = 
ispirnse bas isiom 20 ao: 
t 8fL e.sf és @.9€ 
s bs 8, 2 os See folaivaeque 2 


isubivibat 20 ee: 


él if 9.5 TS ~€,6€ : 
, bas sanpsegnco oivin a 
e ei § 6.05 8S #8.TS 
ony ai paibaste 6a5 sok 
0 es o.es es 68.aS 
—_ es2es001q eft to acitesi 
2.€ 2.88 €-22 O€& as.fs 


se 


93 
Energy, Force and Enthusiasm Displayed in Teaching and 
Concern With Character Development of the Pupils, ranked 
third and seventeenth respectively in the existing 
Situations. 

Of the five highest ranked criteria in the existing 
situation, only two were included among the first five 
listed in the preferred situation. 

Substantial differences in rank between the existing 
and preferred evaluation criteria were identified for 
Gitteensot tuhe thirty criteria. The greatest difference 
in rank was the criterion Examination Results which ranked 
twelfth as an existing criterion and thirtieth as a 
preferred criterion. The second greatest difference in 
ranks was the criterion The Development of the Process of 
Individual Enquiry in the Pupil which had an existing rank 
of twenty-seven and a preferred rank of eleven. The Ghica 
greatest difference was the criterion The Training of 
Pupils in Self Expression which ranked twenty-second as 
an existing criterion and eighth as a preferred criterion. 

For the criteria which had a substantial difference 
in rank, the respondents desired decreased importance to be 
given to the criteria Academic Qualifications and 
Knowledge of the Curriculum, The Methods of Lesson 
Presentation Used, Supervision and Checking of Written Work, 
Examination Results, The Use of Teaching Aids, The Dress 
and Appearance of the Teacher, and The Professional 


Activities of the Teacher. They also desired that increased 
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94 
importance be given to the criteria Concern With the 
All-round Development of the Pupils, The Degree of 
Co-operation by the Teacher With Other Staff Members, 
Concern With Character Development of the Pupils, The 
Provision Made for Individual Differences and Group Needs, 
The Training of Pupils in Self Expression, The Pupils’ 
Appreciation of Moral and Ethical Standards, The Development 
of the Process of Individual Enquiry in the Pupils, and 
Ties tlaininad sOrebupiis ai Civic Competence and 


Responsibility. 


Spearman Rho Calculation 
The Spearman rho was calculated and was found to 
be .53. This value suggested that there was a positive 
correlation between the existing use of the listed 
criteria and the preferred use of these criteria; that is, 
the criteria perceived to be given great importance in les 
existing situation tended to be given great importance in 
the preferred situation and, conversely, evaluation 
criteria perceived to be given little importance in the 
existing situation tended to be perceived as being given 
little importance in the preferred situation. 
Emphasis Placed Upon 
Categories of 
CEIcenla 
An analysis of the emphasis which evaluators placed 
upon each of Mitzel's categories of process, product and 


presage criteria as perceived by the respondents to exist 
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when teachers are evaluated is presented in Table 21. This 
table was derived from Table 18 (p. 83) and is dependent 
upon the categorization of criteria presented in 


Appendix B. 


Table 21 


Rank Order of Criteria Perceived to be 
Employed in Evaluating Teachers 
Grouped According to Mitzel's 


Categories 
—————————————————————————————————————————————————————————— ——————————————e 
Category Rank as Per Table 18 
ee ee 
Process le 26 39 oe OF Iya) lye) 357) 8550 
Product 10,4 2% Why 9, 2.2% 5:42 4, 255,260,727, 28 
Presage Ae S19 ele 5 2620 21 22D 29 


i 


Analysis of Table 21 shows that the teachers 
perceived the greatest emphasis to be placed upon process 
criteria, and the least emphasis to be placed upon product 
criteria when evaluating teacher effectiveness. This 
finding coincides with that of Moore (1966), Thomas (1969), 
and Rogers (1970) who found that both inspectors and 
principals emphasized process criteria and de-emphasized 
product criteria in evaluating teachers. 

Table 22 presents an analysis of the preferred 
emphasis to be placed upon the three different criteria 
categories in teacher evaluation. This table refers to 
Table 19 (p. 87) and to the grouping of criteria presented 


in Appendix B. 
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96 
Teachers preferred the greatest emphasis to be 
placed upon process criteria and the least emphasis to be 
placed upon presage criteria. They also preferred product 


criteria to be given greater emphasis. 


Table 22 


Rank Order of Criteria Preferred to be 
Employed in Evaluating Teachers 
Grouped According to Mitzel's 
Categories 
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Category Rank as Per Table 19 
Process amor O elo, Lone eon S 
Produc eonorut, tOrtoplo, 25,24, 30 
Presage OP eis eo boy ep 2 OP LO. OD, 26, 29 





It was concluded that process criteria were 
emphasized by evaluators and teachers in evaluating teacher 
effectiveness, and that teachers preferred an increased 
emphasis upon product criteria for evaluation. 

RELATIONSHIPS BETWEEN CHARACTERISTICS OF 

RESPONDENTS AND THEIR PERCEPTIONS 
OF EXISTING EVALUATION CRITERIA 

One of the purposes or this study was, to determine 
whether any significant relationships existed between 
teachers perceptions of existing evaluation criteria and 
six personal and professional variables. The six variables 
were as follows: level of instruction; age; sex; years of 


teaching experience; position held; years of post-secondary 
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education (see Appendix A). 

Since there were infrequent responses to some of 
the response categories of the six variables, the data 
collected was collapsed into the following response 
categories: Level of instruction--all respondents in the 
"do not teach" category were high school teachers and 
were placed into the 10-12 category; Age--(1) 30 and under, 
(2) 31-40 pe (3) 41250; (4) Sigand over; jYears of 
experience--(1) 2 or less, (2) 3-9, (3) 10-19, (4) 20 or 
more; Years of post-secondary education--(1) 2 or less, 

(2) ns) 4 ee 5) Gon more. 

Since this study was interested in the perceptions 
of teachers who had knowledge or views regarding evaluation 
criteria, the "do not know" response category was omitted 
from statistical analyses. 

A chi square test was performed to determine 
relationships between each of the six variables and the 
teachers' perceptions of evaluation criteria. These 
relationships were accepted as being significant at the 
.05 level or less. Significant relationships were found 
in twenty-eight instances and are presented in Tables 


23-28. 


Level of Instruction 
Table 23 shows that significant relationships 
existed between the level of instruction variable categories 


when teachers responded to three of the thirty criteria 
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listed for scoring. 

Grade 10-12 teachers tended to perceive the 
All-round Development of Pupils criterion to be given La ee 
importance more often than did teachers of the other grades. 

Teachers at the 7-9 level of instruction tended to 
perceive the Use of Teacher Aids criterion to be given 
greater importance than the teachers at the other levels 
of Instruction did 

Teachers at the 10-12 level of instruction tended 
to perceive the Provision for Individual Differences and 
Group Needs criterion to be given lesser importance more 


often than did teachers at the other levels of instruction. 


Age 

Table 24 shows that ten significant relationships 
existed between the age of the respondents and the 
evaluation criteria listed for scoring. 

Teachers who were thirty years of age or younger 
tended to perceive the criterion of Teacher Dress and 
Appearance to be given lesser importance in teacher 
evaluation more often than did older teachers. The majority 
of the teachers in the 31-40 age category tended to perceive 
this criterion to be given greater importance than hie) cel ave: 
teachers in the other age categories. 

The perceived importance given to the Teacher-Pupil 
Relationships, Development of the Process of Individual 


Enquiry in Pupils, Professional Activities of the Teacher, 
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Training of Pupils in Civic Competence and Responsibility, 
and Pupil Attitudes of Courtesy, Industry and Self-reliance 
criteria tended to increase with the increase in the age 
of the respondents. 

The nature of the relationship between the age 
variable and teachers' perceptions of the importance given 
to the Provision for Individual Differences and Group 
Needs, evaluation cmuiterion was not discernable. 

The majority of teachers in the 41-50 age category 
more often perceived Pupil Attitudes to School and Authority 
to be an important evaluation criterion than did teachers 
in the other age categories. 

Teachers' perceptions of the importance given to 
The Degree of Self-evaluation of the Processes Involved and 
to the Teacher's Standing With Pupils criteria tended to 


increase with an increase in age. 


Sex 

The three significant relationships between the sex 
of the respondents and their perceptions of the importance 
given to evaluative criteria are presented in Table 25. 

Female teachers tended to perceive the criterion of 
Pupil Class Participation to be given great importance more 
often than male teachers did. 

Male teachers tended to perceive the Professional 
Activities of the Teacher criterion to be given greater 


importance more often than did female teachers. 
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Female teachers tended to perceive the Student 
Attitudes to School and to Authority criterion to be given 


greater importance than male teachers did. 


Years of Teaching 
Experience 


The significant relationships between the years of 
experience variable and teachers' perceptions of evaluative 
criteria are shown in Table 26. The relationships pertained 
to three criteria, namely, All-round Development of the 
Pupils, Professional Activities of the Teacher, and 
Teacher-Pupil Relationships. In all three instances, 
teachers' perceptions of the importance given to these 
criteria tended to increase with an increase in the number 


of years of teaching experience. 


Position Held 

Seven significant relationships existed between the 
position held variable and teacher's perceptions of the 
importance given to evaluative criteria. These relation- 
ships are presented in Table 27. 

Principals tended to perceive the All-round 
Development of Pupils criterion to be given great importance 
whereas Department Heads tended to perceive this criterion 
to be given little importance. 

Department Heads tended to perceive the Examination 
Results criterion to be given great importance more often 


than teachers in other positions. 
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Principals more often perceived Teaching Energy 
and Enthusiasm and Supervision of Written Work to be 
important evaluative criteria than did teachers holding 
other positions. 

Vice-principals tended to perceive the Pupil 
Attitudes of Courtesy, Industry and Self-reliance criterion 
to be given little importance more often than the other 
teachers did. 

Principals and Vice-principals tended to perceive 
the Leadership Qualities criterion to be given great 
importance more often than other teachers did. 

Vice-principals tended to perceive the Pupil 
Self-expression criterion to be given little importance 
more often than other teachers did. 

Years of Post-secondary 
Education 

Table 28 shows that significant relationships 
existed between the years of post-secondary education 
variable and perceptions of the importance given to the 
All-round Development of Pupils and Teacher Co-operation 
with Staff criteria. In both instances the nature of the 
relationship was not clear. 

RELATIONSHIPS BETWEEN CHARACTERISTICS OF 
RESPONDENTS AND THEIR PREFERRED USE 
OF EVALUATION CRITERIA 
This study attempted to determine whether 


significant relationships existed between teachers' 
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BEEZ 
preference for the importance given to evaluation Colreria 
and the six personal and professional variables mentioned 
above. 

The same collapsed response categories of the six 
variables indicated in the above section were used in the 
statistical analyses, and the "do not know" response 
category was also omitted from the statistical analyses. 

A chi square test was performed to determine 
relationships between each of the six variables and 
teachers' perceptions of the preferred importance given to 
evaluation criteria. These relationships were accepted at 
the .05 level or less. Significant relationships were 


found in twenty instances and are presented in Tables 29-33. 


Level of Instruction 

Table 29 shows that three significant relationships 
existed between the level of instruction variable and 
teachers' preference for the importance given to evaluative 
criteria. 

The nature of the relationship between the levels 
of instruction and the preferred importance of the 
Examination Results criterion was not clear, but teachers 
at the lower levels tended to be more uncertain about the 
importance that this criterion should be given than were the 
teachers at the higher levels. 

Teachers at the higher level of instruction tended 


to prefer that the Development of Individual Enquiry in 
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Pupils criterion be given greater importance than did 
teachers at the lower levels of instruction. 
Grade 4-6 teachers tended to prefer that the 
Professional Activities of the Teacher criterion be given 


less importance than did teachers of the other grades. 


Age 

Table 30 shows that five significant relationships 
existed between the age of the respondents and the 
preferred importance given to evaluation criteria. 

Teachers who were fifty-one years of age or older 
tended to prefer Teacher Appearance and Dress to be given 
greater importance as an evaluative criterion than younger 
teachers did. Teachers thirty years of age or younger most 
often indicated a preference for little importance to be 
given to this criterion. 

Teacher preference for Academic Qualifications and 
Knowledge of the Curriculum, Teacher Intelligence, and 
Professional Activities of the Teacher as important 
evaluative criteria tended to increase with an increase in 
age. 

The nature of the relationship between the sex of 
the respondents variable and the preferred importance given 


to the Teacher Personality criterion was not discernable. 


Sex 
Four significant relationships existed between the 


sex variable and the preferred importance given to 
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ULF. 
evaluative criteria. These relationships are shown in 
PablLe-3 1c. 

The nature of the relationship between the sex of 
the respondents variable and the preferred importance 
given to the Teacher Personality criterion was not 
discernable. 

More female teachers than male teachers tended to 
prefer Use of Teaching Aids as an important evaluative 
criterion. 

More male teachers than female teachers tended to 
prefer Leadership Qualities and Participation in the 


Community as important evaluative. criteria. 


Years of Teaching 
EXpen Lenee 


Table 32 presents the significant relationships 
between the years of teaching experience variable and 
teachers' preferred importance given to evaluation criteria. 
Three significant relationships were found to exist. 

More teachers with two or less years of teaching 
experience tended to prefer that little importance be 
given to the Method of Lesson Presentation criterion than 
did teachers with more than two years of teaching 
experience. 

The preference for greater importance given to 
Teacher Participation in the Community as an evaluative 
criterion tended to increase with an increase in the number 


of years of teaching experience. 
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The nature of the relationship between the years 
of experience variable and preferred importance given to 
the Self-evaluation of the Processes Involved criterion 


was not clear. 


Position Held 

No significant relationships between the position 
held variable and teachers' preference for the importance 
given to evaluative criterion listed were evident. 
Years of Post-secondary 

Education 

Table 33 shows that five significant relationships 
existed between the years of post-secondary education 
variable and teachers' responses to the preferred importance 
given to evaluation criteria. 

Teacher preference for the importance that should 
be given to the use of Examination Results and Academic 
Qualifications and Knowledge of the Curriculum as evaluative 
criteria tended to increase with an increase in the number 
of years of post-secondary education. 

The nature of the relationships between the years 
of post-secondary education variable and the preferred 
importance given to Development of Individual Enquiry in 
Pupils, Leadership Qualities, and Participation in the 


Community criteria were not clear. 
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SUMMARY 


The majority of respondents perceived sixteen of 
the thirty criteria listed for scoring to be given "great" 
or "very great" importance in the existing evaluation 
situation. According to their perceptions, the criteria 
which were given the greatest importance were Class Control, 
Lesson Preparation and Planning, and The Energy, Force 
and Enthusiasm Displayed in Teaching. 

The majority of respondents preferred that 
twenty-eight of the thirty criteria be given sQEeat Or, 
"very great" importance with the greatest impor tances tO, le 
given to Concern With the All-round Development of the 
Pupils, The Energy, Force and Enthusiasm Displayed in 
Teaching, and Concern With the Character Development of 
the Pupils criteria. 

When a comparison of the extent to which each of 
the evaluative criteria is used or should be used was made, 
substantial differences were identified for fifteen of the 
thirty criteria. However, the Spearman rho calculation 
showed that no overall difference existed. 

An analysis of teacher's perceptions Gi) the 
emphasis which evaluators placed upon each of Mitzel's 
process, product, and presage criteria categories showed 
the emphasis to be placed upon process criteria. A similar 
analysis of preferred criteria showed that the majority of 


teachers preferred the emphasis to be on process criteria 
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and that increased emphasis be placed upon product criteria. 

Twenty-eight significant relationships between 
characteristics of respondents and their perceptions of 
the importance given to the listed evaluation criteria. 
Ten of these relationships pertained to the age of the 
respondent variable. Twenty significant relationships 
existed between the personal and professional variables 
and the preferred importance given to the evaluative 


criteria. 
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Chapter 6 
COMMENTS ON THE STUDY 


Teachers were invited to make comments regarding 
the evaluation of teachers, the personnel employed for 
evaluation, or about the study itself. Twenty-seven percent 
of the respondents accepted the invitation. The large 
number of comments (95) was taken to be an indication of 
teachers! concern about teacher evaluation. 

The comments were classified under the following 
headings: 

1. General reaction to the instrument 
2. Evaluation personnel 
3. Evaluetionecritenia 
4. Frequency of evaluation 
5. General comments. 
Because of the large number of comments and the length of 
some of these, only a few representative ones have been 
included below. These comments were included as written 
by the respondents. 
General Reaction to the 
Instrument 
Some of the questions in this study sheet were 
difficult to answer with accuracy because many of the 
statements can be qualified in various ways depending 
on the area in which you are employed. 
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After asking the first four to six questions——why 
is it that you just don't ask the teacher's name. I 
Suppose its just not needed then. 


Questionnaires like these are so lengthy and 
oftentimes questions are vague. I spent quite a while 
at filling this questionnaire with considerable thought. 
Yet I wonder whether the following day and more thought 
would perhaps have changed my responses. (Am I 
evaluating your questionnaire?) 


(1) tiefeehethere fshinsuffieient |choice sinseyour 
response key; surely there is an area between great 
importance and little importance. (2) I don't think 
your instrument will give you results that will be 
either reliable or valid. But I'll still be interested 
in reading them. 


Student teachers could be good evaluators of 
teachers. Other teachers can only evaluate socially 
unless allowed interroom visitations. 

I'm not sure of what you meant by existing 
conditions: existing in my own mind and classroom, or 
existing in the system itself? 

Many of the questions have extenuating circumstances 
which cannot be expressed on the sheet and space 
provided. 


This is extremely difficult and vague to be handled 
and attacked by us; since we really do not yet have 
any such type of merit rating in our system here. 

A look in future development, however, would seem 
to suggest the implementation of a type of teacher 
evaluation program. 


This is a very difficult questionnaire to under- 
stand and also to see the purpose of. Your objectives 
are not very clear. 


Many questions are liable to several interpretations. 


Evaluation Personnel 





I think there should be more evaluation of a teacher 
by his colleagues, his department head and his principal. 
I feel many superintendents are “out of touch" with 
what goes on in the classroom or in a particular subject 
area. Superintendents "barge" into your classroom and 
expect to see you at your best. The teacher may be 
having an off day for one of many reasons. I feel that 
external evaluations by administrators are not too 
valid. Evaluation should be done by colleagues in your 
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subject area. There should also be more emphasis on 
self-evaluation I feel that I Know when I am doing a 
good job or have taught an exceptional class. 


Evaluation by a visiting superintendent or other 
supervisory personnel (visiting) is unrealistic and 
worthless because: 

(1) some teachers keep special plugged lessons ready 
for such events, 

(2) these evaluating visitors, being too seldom on the 
classroom scene, create an unnatural climate based 
on the teacher's fear of the evaluator's power. 

Therefore, evaluation should be based on observations 

of the principal, other teachers on staff and, not 

lastly, the students. The teacher knows also whether 
the daily performance is meritable. 


As a principal I would rather see a team approach 
involving the teacher, the principal, and central 
office personnel. The teacher would provide a written 
statement of emphases for self improvement at the 
beginning of the year. During the year areas for 
needing improvement would be followed up and evaluated 
with summary copy for the teacher. It seems that the 
principal is necessarily involved. 

Unfortunately your questionnaire is quite inadequate 
to probe a fuller picture of constructive suggestions 
and appears to force one's views to converge onto an 
expected “consensus. 


The basic philosophy of Evaluators, whoever they 
are, would be the most important concern. A man with 
the dogmas of one or two education faculties would be 
limited. His views would be coloured and limited. A 
set of standards and thorough background, therefore, in 
the evaluator, would be most important. 


I believe in training children to be responsible. 
When a teacher has acquired professional status I 
believe that they definitely should be responsible. I 
might be all right to check them originally but I do 
believe that there are so many ways of checking--such 
as results as seen from both curricular and 
extra-curricular activities. I believe that 
professionals should definitely self-evaluate. 


Administrators who have been too long away from 
the classroom are not the best judges of a teacher's 
capabilities. 


The principal and department head are in the best 
position to evaluate success of a teacher within a 
school. However, I would not want to be in the position 
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of the principal and have to make the decision re a 
teacher *s dismissal or related actions~ 


Teacher evaluation in the province is carried out 
almost exclusively by personnel who have themselves 
been removed from the classroom for several years. 
This is a mistake since schools today are not what 
they used to be in "the good old days." By that I 
mean that they are neither better or worse, but they 
are different. I think teachers should be evaluated 
by those who are teaching an equal load and are still 
actively engaged in teaching. 


I feel that evaluation of a teacher should never 
be based on one school superintendent, one principal, 
one group of students, etc. An over-all performance 
in different teaching situations would have to be 
adopted which in turn would also require several years 
to complete. 


Many forces should be considered in teacher 
evalution, and discretion must be used in interpreting 
student, principal, self assessment, etc. Different 
disciplines and different situations are unique and 
require unique evaluation. This questionnaire doesn't 
really allow for justification of "preferred evaluation 
techniques. 


The people charged with evaluation of teachers 
should have a broad knowledge of people, society, and 
human nature. A good evaluation might be made if the 
teacher, as well as the students, were not thought of 
as machines. 


All personnel employed for the purpose of evaluation 
should also be in contact with the level they are 
involved with, as teachers, perhaps on a part time basis. 
Many educators today have forgotten or never been in 
contact with students and learning of today. As one 
of today's educators I question value judgments from 
one of yesterday's educators. 


I believe that well disciplined, learned students 
are the end result of all teaching and that somewhere 
somehow their evaluation and considerations should 
become a part of the evaluation process. 


Evaluation by others is necessary but would be 
more effective if there could be a follow-up of these 
evaluations where the teacher could study the evaluation 
with the evaluator and discuss both his strong points 
and his weak points and also feel free to defend 
himself if he feels that he was incorrectly assessed. 
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I would hope that the teacher himself, his 
colleagues, and his principal could become more involved 
in evaluating teachers, through this survey. 


Evaluation Criteria 


Section III is very poorly worded. You want a black 
and white answer in idealistic situations. For 
questaons slicheashsii7ms, c0gtagi1s716,b9722),.259m~ande287 
the quality of student, home backing, resources 
availablejaphysicalmconditiens,ointhetschool, extra 
curricularsactivities,ofsthe student: “these, and many 
more elements come into play. A teacher often has 
strong odds against her causing progress in a student, 
especially the home situation of a child. These 
qualities of self expression, morals, self control, 
etc. do not always become apparent immediately but the 
effect of a particular teacher may manifest itself 
when the child matures more. What I'm trying to say is 
an inch of progress with one child may require more 
ability, more energy and more interest than two miles 
of progress with another child. For someone to come 
in and judge a teacher without knowing the students 
indtyadualivejsea Larce. 


IT found=manydofathedcriteriasdifficultsto respond 
to confidently. An example of what I mean is: The 
importance given to "the attitude of the pupils to the 
school and to authority" in evaluating a teacher. If 
this criterion suggests that a competent teacher should 
be capable of altering the pupils' attitudes, then my 
response would be "2." There are many other factors 
which have a strong influence on the pupils' attitudes. 
If the criterion suggests that pupils' attitudes would 
obviously affect the teacher's methods and possibly 
"success" in teaching, then it would be of great 
importance. 

I would also like to comment that the importance 
of many of the criteria would vary according to age 
Groupror gradewlevel* 


Evaluation of teachers should definitely be made 
to a greater extent. The intelligence of a teacher 
has little effect on her good job with her students 
(within limitations of course). You do not have to 
have "A" marks to be a good teacher. A good teacher is 
one who is loved by the students because they have 
really learned a lot during the year both material in 
books as well as behavior and respect for others. 
Things like this should be evaluated. 
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The basis should be on how well a teacher can 
communicate with the student as a human being firstly. 
When this has been accomplished, the teacher will be 
able to understand each student, thus being able to 
make the teaching methods used most effective for each 
individual. To me this is the basic requirement for 
a successful method of education. 


I question some of the criteria for evaluation of 
teachers. Some of them regarding a pupil's appreciation 
of moral and ethical standards, attitudes to school 
and to authority, and courtesy, industry and 
self-reliance depend greatly on the area in which you 
are teaching and the home situation. Can one 
standardize such criteria? 


If a teacher is to be evaluated by pupil attitudes 
anchesehayuor, a thorough study of the children’s 
background and homes would be necessary. Class 
behavior, attitudes, self-reliance, and appreciation 
of moral and ethical standards cannot be instilled in 
one year when a child has been raised differently. The 
change of behavior rather than behavior observed for 
five minutes would be a better indicator of what a 
teacher has done. 


I did not understand what was being asked in 
question 29 above... I do feel that since teachers play 
an. jimportant, \role..in -society,,. that he-be evaluated,,in 
all aspects of the roles they play in society. 


Frequency of Evaluation 


Evaluation should be done continuously--he or she 
should be in the classroom constantly--and not through 
hearsay or spotchecks-—-such evaluation would be 
unmerited. 


Any evaluation which is made occasionally could 
be very, very way out. A great deal of research and 
time observing events surrounding each teacher is 
needed to make a fair evaluation. 


I for one disagree that one visit is enough for 
so important a report as our evaluation. I happen to 
run a "lax" class by some "standards" but if my students 
cover the course and a third more outside readings, was 
ita YLaxtme,Onecvisitewould say so. Noise in excess 
prohibits learning, but the teacher knowing the class, 
also knows the level where learning stops. This is 
one of my gripes (a blatant one) about one shot 
evaluation. 
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Can a teacher truly be evaluated by one or two 
superintendents visits, as is now the case? Could not 
evaluation be done yearly--on a pupil response basis? 


General Comments 


I feel that the visits from the Superintendent and 
the supervisors appear to be on too strict a basis. 
Personally I enjoy being observed while teaching as 
it gives me an indication as to whether I'm progressing 
and improving. However, it seems that a majority of 
teachers are frightened of these visits because they 
seem so stoic and final. Is there not some way a 
closer relationship between supervisor and teacher could 
be developed, as these visits are really an advantage 
foreus alley lithinkvevaluations of this sort are truly 
Dene to raul 


I feel teachers are evaluated to appease teachers 
at the present time. Until evaluation is done in 
order to improve standards of teaching (not teaching 
qualifications), evaluation is going to be a waste of 
time. 


Just as we have continuous evaluation of students, 
continuous evaluation of teachers would be helpful, 
especially if evaluation and constructive criticism as 
well as development of teacher-personnel rapport were 
taking place. 


I have found many of the questions vague and I 
do believe that a questionnaire on such a multiple topic, 
pabticularly basecdyonwsuchsdirectu: questioning is 
exceedingly difficult to answer. If teachers are direct, 
open, and honest, and if they have entered teaching 
with the knowledge, creativity, individualism, and 
flexibility demanded by the situation, they are their 
own best evaluators, and people working in close 
contact who know the situation are also beneficial. 
Teaching is too complex not to take the individual 
circumstances to mind. Evaluation based on too many 
impersonnal forms is invalid. 


Formative evaluation is excellent, but what worries 
me is that I should be under the gun so to speak--that 
is--paycheck wise. I feel that if a teacher is 
effective she should be retained, if not effective, fired 
as in other professions. 


In my opinion, no evaluation in any form can be 
completely successful. Results--long term results, are 
the only thing that give any real evaluation. Even at 
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that, there are so many variables that no mere mortal 
can accurately judge a teacher. 


The writer is rather ignorant of the methods used 
to evaluate teachers largely because the criteria used 
are not widely published if they do exist. 
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Chapter 7 
SUMMARY, CONCLUSIONS, AND IMPLICATIONS 
SUMMARY OF THE STUDY 


This study was designed to examine the perceptions 
of teachers in an urban Saskatchewan school district at 
one point in time regarding (1) the existing and preferred 
use of evaluation personnel and (2) the existing and 
preferred importance given to evaluation criteria. 

This study attempted to find answers to the 
following questions: To what extent do certain personnel 
evaluate teachers in the urban Saskatchewan school district 
selected? Which personnel are preferred by these teachers? 
Are there any significant relationships between teachers' 
perceptions of existing and preferred evaluation personnel 
and certain personal and professional variables? What is 
the importance given to evaluation criteria as perceived 
by these teachers? What importance given to these criteria 
do they prefer? Which of Mitzel's categories of product, 
process, and presage criteria are emphasized in the existing 
and preferred situation? Are there any significant 
relationships between teachers' perceptions of existing 
and preferred evaluation criteria and certain personal 


professional variables? 
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The instrument consisted of four sections. Section 
I consisted of six personal and professional variables. 
Section II consisted of nine types of personnel which may 
be involved in the evaluation of teachers. Teachers were 
asked to indicate their perceptions of the use of these 
evaluators in the existing and preferred evaluation 
situation. Section III of the instrument consisted of the 
thirty evaluative criteria, ten in each of Mitzel's 
categories of product, process, and presage. Teachers were 
asked to indicate their perceptions of the importance of 
Bese criteria in vthe existing and preferred evaluation 
situation. In Section IV teachers were invited to comment 
on evaluation and/or the study. 

The population consisted of four hundred and 
sixty-eight teachers in an urban Saskatchewan school 
district. 

The statistical procedures utilized to analyze the 
data included frequency counts to determine the existing 
and preferred use of evaluators and criteria, and to place 
these personnel and criteria in rank order forgtnesexi suing 
and preferred situation to enable comparisons tobe made; 
the Spearman rho calculation to determine whether or not 
any overall differences existed between the existing and 
preferred situation and the ranking of evaluation personnel 
and criteria as perceived in the two situations; and chi 
square tests to determine significant relationships between 


the six personal and professional teacher variables and 
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and existing and preferred use of evaluation personnel, 
and to determine significant relationships between the six 
personal and professional variables and the existing and 
preferred importance given to evaluation criteria. 

A sample of teachers' comments on evaluation and 
the study were classified under the following headings: 
General Reaction to the Instrument; Evaluation Personnel; 
Evaluation Criteria; Frequency of Evaluation; and General 
Comments. 

The different analyses of the data revealed the 
following: 

1. The majority of respondents perceived two types 
of evaluation personnel to be used extensively in 
evaluating teacher effectiveness, namely, their school 
board superintendent and their principal. *e0ther types of 
evaluation personnel were perceived to be infrequently used 
as evaluators. 

2. The majority of respondents preferred ehe 
principal and their school board superintendent to be used 
extensively as evaluators, and they preferred the other 
types of personnel to be used infrequently in teacher 
evaluation. 

3. There was no overall difference in the use of 
evaluators between the existing and preferred situation. 

4. Several significant relationships existed 
between the personal and professional teacher variables and 


the existing and preferred use of evaluation personnel. 
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The majority of these relationships pertained to the level 
oOL.instruction variable. 

5. The majority of respondents perceived sixteen 
of the thirty criteria to be given great importance in the 
existing evaluation situation. 

6. The majority of respondents preferred that 
twenty-eight of the thirty be given great importance when 
teachers are evaluated. 

7. Although there were substantial differences 
in rank. for many of.the criteria listed, no overall 
difference was found. 

8. The respondents perceived the existing emphasis 
to be placed on process evaluative criteria, and preferred 
to have the emphasis on these criteria. However, they 
also preferred an increase in emphasis on product 
CilecL ic. . 

9. Several significant relationships existed 
between the personal and professional variables and the 
existing and preferred evaluation criteria. “The majorrty, 
of these pertained to the age of the respondents and the 
position held variables in the existing situation, and to 
the age of the respondents and the number of years of 


post-secondary education in the preferred situation. 


CONCLUSIONS AND IMPLICATIONS 


The following conclusions and implications were 


drawn from the analysis of the data: 
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1. Teachers' perceptions of the extent to which 
the listed personnel are used in evaluation of teacher 
effectiveness identified two types of evaluators who are 
used extensively, namely, the school board superintendent 
and the principal. It would appear that both types of 
personnel perform dual roles in that they are evaluators 
as well as educational leaders. Since the other types 
of personnel, especially those internal to the school, 
were perceived to be infrequently used, one might also 
conclude that the emphasis was on summative rather than 
formative evaluation. 

2. Teachers' preference for extensive use of the 
principal and the school board superintendent in teacher 
evaluation can be interpreted as an indication that teachers 
were satisfied with the existing evaluation personnel. 
However, the preference for infrequent use of the GEneL 
personnel could also be seen as an indication that the 
teachers do not wish the frequency of evaluation to 
imeredse. 

The preference for infrequent use of personnel 
from the Provincial Teachers' Organization and the 
Provincial Department of Education suggested that teachers 
desired autonomy for their school system and rejected 
involvement of personnel external to the system in teacher 
evaluation. The comments made in this regard suggested 
that teachers rejected these personnel because they have 


been out of the classroom situation too long and are, 
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therefore, unaware of the changes which have taken place 
in students and in teaching. 

3. The preference for the principal as an evaluator 
supported the literature which suggested that the Pprenci pal 
should always be involved in teacher evaluation. 

This information should serve as encouragement for 
principals to play a major role in teacher evaluation and 
as a basis on which to request additional time to conduct 
teacher evaluation. It should also indicate to the school 
board administration that an in-service evaluation training 
program for principals should be initiated. 

4. The comparison of the use of evaluation 
personnel in the existing and preferred situation indicated 
that no overall difference existed between the use of 
these personnel in both situations. This suggested a 
general satisfaction with the extent to which the listed 
personnel were used in the evaluation of teacher effective- 
ness. 

Although there was no overall difference between 
the use of existing and preferred evaluators, some 
noticeable differences were indicated regarding the extent 
of use of certain evaluators. The preferred decrease in 
the use of the superintendent as an evaluator suggested 
that teachers prefer evaluation procedures to be conducted 
by personnel with whom they have more frequent contact and 
who have closer contact with the classroom situation. This 


was also supported by an increase in the preferred use of 
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department heads, self, and students as evaluators. 

5.  Teachers' comments on evaluation personnel 
suggested that no one person should have sole responsi- 
bility for teacher evaluation, but rather that teacher 
evaluation should be carried out by several people and 
more frequently. This was seen as an indication that 
teachers are concerned about evaluation and that they do 
desire professional development and growth. 

In some cases the respondents who differed in the 
six personal and professional variables responded 
differently, t0.ditferent types of evallalLoOrs.e.cince the 
majority of these differences pertained to the level of 
instruction variable, consideration should be given to the 
types of evaluators to be used at different levels of 
Pst UCtLOnNi. 

7. Since sixteen criteria were identified as being 
given great importance, it was concluded that a common 
body of criteria was used in teacher evaluation. Teachers 
who had class control and well-prepared and well-planned 
lessons, and who displayed energy, force and enthusiasm in 
teaching were likely to be considered effective teachers. 
Little attention was given to the results of teaching. 
There may be good reason to de-emphasize product “criteria, 
but research evidence suggests that these criteria deserve 
greater emphasis when teachers are evaluated. 

8. Teachers perceived an effective teacher to be 


one who is concerned with the all-round development ope Piel ale) 
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pupils, who displays energy, force and enthusiasm in 
teaching, and who is concerned with the character develop-— 
ment—ofe the’ pupils’. 

9. The majority of respondents indicated that 
twenty-eight of the thirty listed criteria should be used 
in teacher evaluation. The possibility, therefore, exists 
that these criteria could be used as a basis for development 
of an evaluation system. 

10. Although no overall difference existed between 
the existing and preferred importance of evaluation 
criteria, and although teachers tended to prefer the 
emphasis to remain on process criteria, there were 
substantial differences in the importance given to certain 
criteria. Teachers' preference for increased emphasis on 
product criteria was seen as an indication of the need to 
re-examine existing evaluation criteria to determine 
required modification of the importance given to these 
Criteria. 

11. In some cases the respondents who differed in 
the six personal and professional variables responded 
differently to different evaluation criteria. It was 
concluded that these differences should be taken into 
account when modification of existing evaluation criteria 
are considered. Such consideration would lead to a greater 
acceptance of the criteria used. 

12. From the comments it was concluded that 


teachers are vitally concerned about evaluation personnel 
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and criteria. It would appear that teachers desired some 
changes in the existing evaluation personnel and orl tLeria, 
A co-operative approach to determine such changes is 
warranted. School board administrators should establish 
a committee comprised of teachers, who reflect the personal 
and professional teacher characteristics, and school board 
administrators to examine existing evaluation procedures 
and to determine the required changes. 

RECOMMENDATIONS FOR FURTHER 
RESEARCH AND STUDY 

Studies need to be undertaken to determine whether 
or not differences in the use of evaluation personnel and/or 
the importance given to evaluation criteria exist when a 
distinction is made between summative and formative 
evaluation. 

Experimental studies could be carried out to 
determine the validity and reliability of student and/or 
department head evaluations of teacher effectiveness. 
Similar studies could pertain to self-evaluation and peer 
evaluations. 

The effect of co-operative development of an 
evaluation guide on evaluation procedures and/or teaching 
could be examined. 

A replication of this study could be conducted in 
other urban Saskatchewan school districts to determine 


whether or not any differences in teachers! perceptions 
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exist in these districts regarding teacher evaluation. 
Such information could provide valuable information 
regarding the direction of evaluation procedures. 

Research is required into the methods by which 
evaluators collect data on which to base evaluation to 
determine the most valid and reliable measurement 
techniques. 

Studies could be carried out to determine the role 
of evaluation in the process of supervision. 

Evaluation of teacher effectiveness is important 
to persons directly involved in education and to persons 
concerned about education. Teachers occupy an important 
boste@on ine the field of education; their selection and 
evaluation should be a matter of the deepest concern, and 
should therefore be made on the basis of sound evaluation 
criteria and by personnel who are qualified to evaluate 


them. 
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TEACHER EVALUATION QUESTIONNAIRE 


There are FOUR SECTIONS to this instrument: 


Section I. Personal and professional data questionnaire. 


Lo 


Section II. Existing and Preferred Evaluators. 
Section III. Existing and Preferred Evaluation Criteria. 


Section IV. Comments on the evaluation of teachers and/or the study. 


It will take you approximately 15 minutes of your time to complete the questionnaire. 


You are asked to enclose the completed instrument in the envelope provided and to return it to your principal 
who will forward all questionnaires completed in your school to me. Please do this at your earliest convenience. 


An abstract of the findings will be made available to all participating schools after the study is completed. No 
individuals or individual schools will be identified in the study. 


ion I: PERSONAL AND PROFESSIONAL DATA 


Soya GES pet ee as 2 EOIN a nt OR ee Ser Tae en ees ON RECESS A wins J Ronee 


In which ONE of these grade levels do you spend most instructional time? Check (Y) one. 
yes... Do not teach (2) K-3 (eee 4-6 (4) ce 7-9 (3) oes 10-12 


Age (nearest birthday): Check (VY) one. 


BL et a: 25 or under (4) eras 36-40 GP) ies 51-55 
(2)..........26-30 (5) eens 41-45 (8)2 528 56-60 
3) ics. 31-35 (0) see: 46-50 (Denese. 61 or over 


sexi (1)... Male (CAL me Female 


What is your total number of years of teaching, counselling, library and/or administrative experience? Count this 
year as a full year. Check (Y) one. 


i).....1 yr. (4) .......5-9 yrs. CT) 20-24 yrs! 
(i) eee 2 yrs. Gye ote 10-14 yrs. (3) aa 25-34 yrs. 
(Sy eee 3-4 yrs (6) vs. 15-19 yrs (S)e. 35 or more years. 


What is your position in the school? Check (Y) one. 

(1)...... Principal 

BED) dco Vice-Principal or Assistant Principal 

£3) Biba: Department Head, Grade Co-ordinator, Curricular Associate 

(4) ah: Teacher 

(5) ae CHE (See Ey Yo sa ccccs cates ntl thc narod sinatra sere ee en ci ae aa 


| 
For how many full years of post-secondary education (preparation or training) are you paid? Check (V ) one. 


BL) nick Ye (3) vu.B YES. (5) vencu’d YES. 





Evaluation is an assessment by measurement, rating, or ranking of teacher effectiveness involving value judgments 
based on observations. Evaluation may be formative (for the purpose of promoting the professional growth and de- 
velopment of the teacher) or summative (for the purpose of official reporting of the effectiveness of the teacher 


which may lead to a decision regarding the acceptability of teacher performance). 


Please keep these definitions in mind as you complete the remainder of the questionnaire. 

















Section II: EXISTING AND PREFERRED EVALUATORS 


Instructions: 156 


This section lists 9 types of personnel which may be involved in evaluating teachers. You are asked to indicate y' 
perception of the extent to which each type of personnel is used in teacher evaluation (EXISTING) and the exten 
which each type of personnel should be used in teacher evaluation (PREFERRED). 


Please respond to each question by marking the number that corresponds to one of the following statements: 
. personnel always used in the evaluation of teachers 


5 
4. personnel frequently used in the evaluation of teachers 


3. undecided about the extent of use 
2. personnel seldom used in the evaluation of teachers 
1. personnel never used in the evaluation of teachers 
0. do not know the extent of use 
Example: 
What do you perceive to be the Existing and Preferred extent of use Of ....ccnneseeccenmmmnnnnne in the evalua 


of teacher effectiveness? 
Existing Preferred 
1. The Minister of Education 5 [4]3..2 1.0 | 54 3fa]4 


The responses indicate that the respondent perceives that the minister of education is frequently used in the evalua 
of teachers, however, he would prefer that the minister of education should seldom be used in the evaluation of teac 


RESPONSE KEY 
5. Always 4. Frequently 3. Undecided 2. Seldom 1. Never 0. Do not know 





Existing Preferred 
1. Provincial Department of Education Personnel 5. 453 SZ ee 
2. Provincial Teachers’ Organization Personnel 5iad. CaP 27a 
3. Your School Board Serer encct hd On oe 
4. A group of administrators and/or supervisors from your school district 
central office oe oe Le 5 “4 3 eee 
5. Your school principal Date eo ee ee 5 ape gy 2aar 





6. Your Department Head, Grade Co-ordinator, or Curricular Associate 54 372 2130 3... 4. oan 


7. Your colleagues (other teachers in your school) 5B) 41802 dda 5. 4.8 2 am 
8. Yourself (by completing a written report) 5.4 oO See ele 5 a On eee 
9. Your students (by completing a written report) 5) Spe al 5 4 3)2 7 i 





: 


on Ill: EXISTING AND PREFERRED EVALUATION CRITERIA 
ctions: © ! T5y 


is section lists 30 criteria which may be employed in evaluating teachers. You are asked to indicate your perception 
he importance that each criterion is given in teacher evaluation (EXISTING) and the importance that each criterion 
d be given in teacher evaluation (PREFERRED). 


lease respond to each question by marking the number that corresponds to one of the following statements: 
. criterion of very great importance 
. criterion of great importance 
I. uncertain about the importance of criterion 
. criterion of little importance 
. criterion of no importance 
. do not know the importance of criterion 
ple: 


hat do you perceive to be the EXISTING and PREFERRED importance given to each of the following criterion 
Ihe evaluation of teachers: 


Existing Preferred 
The self-reliance of the teacher? By EES) [2| 1 0 ARS yom e . O. 


i responses indicate that the respondent perceives that this criterion is given little importance in the evaluation of 
Mhers, however, he prefers that this criterion should be given very great importance in the evaluation of teachers. 











RESPONSE KEY 


ery great importance 4. great importance 3. undecided 2. little importance 1. no importance 0. do not know 








Existing Preferred 

| Concern with the all-round development of the pupils? Bi dees ate eee 5F 4-2 0 
A Lesson preparation and planning? Sa On a le U SAAS Sie 2a le 0 
Withe personality of the teacher? 5.4 9 2 1 cOnMisteanisiye wo 
J Examination results? Brag oie Oo ener meet eg 
| Pupil participation in class? bie Agr Oy se un By eS ae 0 
ithe dress and appearance of the teacher? Sierra ee aU) Se 4ecd oma 0 
I The pupils work well without supervision? 54 Omen Le a0 5) 43 eae. O 
i'Teacher-pupil relationships? GY gels oleae ee! 5 a3 Zoe 
Pe cademic qualifications and knowledge of the curriculum? speek pioay, allel) Bird! 3h Peale 0 
The development of the process of individual enquiry in the pupils? A a ron sO Bae aan Le 


NClass control? 
if 

| 

} 


i The level of intelligence of the teacher? 5 ed) oan an laa Bud: Ba ale 70 
| ‘Concern with character development of the pupils? Roma seme. lee O Leek: Yams ered a ON 
The energy, force and enthusiasm displayed in teaching? 54) 3. 2: 1.0 br ay Seen 0 


Whe professional activities of the teacher? 5 4 3 2 


| The training of pupils in civic competence and responsibility? Beano ek. 0 Bade fame 0 
il 


RESPONSE KEY 158 


5. very great importance 4. great importance 3. undecided 2. little importance 1. no importance 0. do not ky 


Existing Preferred 


17. Supervision and checking of written work? Baa) end a) 


18. The degree of co-operation by the teacher with other staff members? 5 4eSiaZdeii) 





19. Pupil attitudes of courtesy, industry and self-reliance? S 4-15 se en 
20. The methods of lesson presentation used? 5 ae NO orale 
21. The loyalty and dependability of the teacher? BD dt NS PRA 
22. The pupils’ appreciation of moral and ethical standards? 5 4°3 2°10 
23. The use of teaching aids? 5 AS 12a 
24. Qualities of leadership displayed by the teacher? 5 aoe Le 0 
25. The training of pupils in self expression? 25409 7 cn eeu 
26. The provision made for individual differences and group needs? bed aot 2 st 
27. The teacher’s participation and standing in the community? 5) 4513 2 Teo 
28. The attitude of the pupils to the school and to authority? 584 "3 a2 “10 
29. The degree of self-evaluation of the processes employed? UE: Wine ee ae Be <) 
30. The teacher’s standing with the pupils? Sey” Pe terres Eat) 











Section IV: COMMENTS 


If you wish to make any comments regarding the evaluation of teachers, the personnel employed for evaluation, 
about this study, please feel free to do so. 


dececusecebeseserncausveesvevereeneeysevaeaneeesesssse reese GasepeeeneseeussageeraesesnsreehisheDObeOeeeseesssusesssssusnysaueeenraeanasilaegsaeunensshesesehenenernaneseeseseersesnanssenesaenenheaeneebeasessnengeueanegeneaeaassusnasauauacaursecssanauansnesayasnsenervescseanecssavarenecnetenseneancaesuacsnuacuguanarsassssnseanuasessses eased] 


delecycuecuccucecescecaunssnvavetanaeeseseceteenoanserssssespegeleeesenegusagarsenessessesesaeeeesssneagenagneaeeneagsasupensaeupeneensvssesassassesanseneehtereee Meee Renner easssesmansneen sagan sees eenessemenuensaenssgsucnussusausenassaasseusravaucneneussassashesaspenseuenscusussacanssenbensauaecsssansasenensansarsaussesssnsssSeeshea) 


THANK YOU FOR YOUR COOPERATION 
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THE UNIVERSITY OF ALBERTA 
EDMONTON 7, CANADA 


FACULTY OF EDUCATION 


DEPARTMENT OF EDUCATIONAL 
ADMINISTRATION 





February, 1972 


Dear Principal: 


I am requesting your cooperation in distribution 
and early completion of the enclosed questionnaire. The 
covering letter to teachers explains the purpose of this 
study. 


Would you please carry out the following 
procedures: 


1. Complete one questionnaire yourself. 

2. Distribute one copy of the covering letter, one 
questionnaire, and one envelope to each staff member 
in your school who holds a valid teaching certificate. 

3. Provide a method to allow teachers to return completed 
questionnaires. 

4. Mail the completed questionnaires in the enclosed 
stamped addressed envelope. 


I am hoping for a high percentage of questionnaire 
returns to gain a more extensive picture of teachers' 
views. I hope, therefore, that you will try to obtain 
replies from every staff member. 


I am enclosing two extra copies of the questionnaire 
for yourmenimless 


Thank you for your cooperation. 


Sincerely, 


AAS till 


Adolf atd. VOLK 
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THE UNIVERSITY OF ALBERTA 
EDMONTON 7, CANADA 


FACULTY OF EDUCATION 


DEPARTMENT OF EDUCATIONAL 
ADMINISTRATION 





February, 1972 


Dear Colleague: 


The question of evaluation of teacher effectiveness 
is of concern to the general public, to school adminis- 
trators, and to teachers. Several research studies have 
been conducted in this area, but few studies have sought 
the views and opinions of teachers. The purpose of this 
study is to examine the perceptions of teachers (including 
principals) regarding existing evaluation personnel and 
the criteria they employ, and regarding preferred 
evaluation personnel and preferred evaluation criteria. 


I am requesting that you complete the accompanying 
questionnaire, place it in the envelope provided, and 
return it to your principal who will forward the 
questionnaires to me. 


You will find that the questionnaire will take only 
a short time to complete. May I assure you that individual 
responses will be treated in the strictest confidence. 
The data will be presented in the form of consolidated 
findings. An abstract of these findings will be made 
available. to. all. participating schools. 


Your cooperation and promptness in completing and 
returning the questionnaire will be greatly appreciated. 


Sincerely, 


Adve} Vile. 


Adolf J. Volk 
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FACULTY OF EDUCATION 
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THE UNIVERSITY OF ALBERTA 


EDMONTON 7, CANADA 
ADMINISTRATION 


Februarye 21,0. .9/2 


Dear Principal: 


At the February 1, 1972 Administrator's Dinner 
Meeting I distributed a package of questionnaires for the 
teachers in your school relating to my thesis study 
regarding teacher evaluation. As yet I have had no response 
from your school so I write to ask if you would be kind 
enough to collect the completed questionnaires from your 
teachers and forward them to me as soon as possible. 


I am anxious to include your opinions and those 
of your staff in the consolidated responses, the analysis 
Of which must commence very soon. If you have mislaid 
the questionnaires I would be pleased to send another set 
tO.vou. 


I realize that principals and teachers are 
constantly under the pressure of work and I do apologize 
for the extra demands made on your time, but I do hope 
that the findings of this study will be informative as 
well as revealing. ‘ 


May ietakesthis opportunity to thank you in 
anticipation for your cooperation and assistance in this 
matter. 


Sincerely, 


Adolf J. Volk 


P.S. If you have already forwarded the completed 
questionnaires to me please ignore this request. 
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APPENDIX B 


CRITERIA USED IN THE INSTRUMENT 
SET OUT IN CATEGORIES 
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CRITERIA INCLUDED ALTERNATELY ON THE 
INSTRUMENT GROUPED ACCORDING 
TO MITZEL'S CATEGORIES 


Ate RODUCT) CRITERIA 


Concern with the all-round development of the pupils. 
Examination results. 

The pupils work well without supervision. 

The development of the process of individual enquiry 
ine thespupwls:. 

Concern with character development of the pupils. 

The training of pupils in civic competence and 
responsibility. 

Pupil attitudes of courtesy, industry and 
self-reliance. 

The pupils' appreciation of moral and ethical standards. 
The training of the pupils in self expression. 

The attitude of the pupils to the school and to 


authority. 


B. PROCESS CRITERIA 


Lesson preparation and planning. 
Pupil participation in lessons. 
Teacher-pupil relationships. 


Class. control. 
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The energy, force and enthusiasm displayed in 
teaching. 
Supervision and checking of written work. 
The methods of lesson presentation used. 
The use of teaching aids. 
The provision made for individual differences and 
group needs. 


The degree of self-evaluation of the processes employed. 
C. PRESAGE CRITERIA 


The personality of the teacher. 

The dress and appearance of the teacher. 
Academic qualifications and knowledge ene rele 
GuGE LCusUnrs 

The level of intelligence of the teacher. 

The professional activities of the teacher. 

The degree of co-operation by the teacher with other 
staff members. 

The loyalty and dependability of the teacher. 
Qualities of leadership displayed by the teacher. 
The teacher's participation and standing in the 
community. 


The teacher's standing with the pupils. 














